This repo contains scripts that the Austin Transportation and Public Works Department uses for 311 request reporting and visualization.
This python script pulls CSV reports from the City's 3-1-1 system. These reports contain information on what was reported by the request from the public and when/how the department took action to resolve it. These reports are then stored in a City datahub dataset.
requests_to_socrata.py processes a report that contains request-level data on 3-1-1 service requests. There is one row per service request.
python -m etl.csv_reporting.requests_to_socrata
"Flex notes" are questions that are asked based on the type of request that is submitted. Each request can have multiple flex questions/answers. flex_notes_to_socrata.py processes a report that contains the flex notes.
python -m etl.csv_reporting.flex_notes_to_socrata
311 Requests typically contain activities which document the steps that city staff have taken to resolve a 311 request. activities_to_socrata.py processes a csv report that contains activities.
python -m etl.csv_reporting.activities_to_socrata
This script utilizes the Austin Open311 website's API to download request data and store it in a Socrata open data portal dataset. This allows for more frequent updates as compared to the CSV reporting which is run once daily. This is then used to create a real-time updating map for ATPW to visualize requests during emergencies for prioritization.
Supplying a date (with either -d or --date) is required and that will retrieve all requests updated after that date.
python -m etl.open311.open311_to_socrata -d 2025-10-15T06:55:01.132759+00:00
All required environment variables are in env_template and can be found in our password storage.
An API key for Open311 can be requested here.
Note that you also must be on the City network or you will likely not be able to retrieve the reports from 3-1-1. You will see this error:
Unexpected file type returned from the CSV endpoint. Check that you are on the city network.
It's likely that your request is getting flagged as a bot by the web app firewall.
This repo can be used with a docker container. You can either build it yourself with:
$ docker build . -t dts-311-reporting:production
or pull from our dockerhub account:
$ docker pull atddocker/dts-311-reporting:production
Then, provide the environment variables described in env_template to the docker image:
$ docker run -it --env-file env_file dts-311-reporting:production /bin/bash
Then, provide the command you would like to run.