The standardized input data layer, or SIDL, is designed to automate the data platform and isolate the varieties of source data structures and format.
The data will go through the rules engine, which will process the user's data and determine whether the data are compatible with AQDC's basic quality characterization including but not limited to date/time stamps, how the pollutants are named, and more.
Apache Superset is an open source, python based web application that allows for data visualization and interactive exploration. Individuals can create visualizations in Superset using their own or public data available in the platform. Users will have the option to submit their visualizations to be viewed by the public on https://aqdatacommons.org.
[Forthcoming] Jupyter Notebook
The Jupyter Notebook is an open-source web application that allows users to create and share documents that contain live code, equations, visualizations and narrative text. Uses include: data cleaning and transformation, numerical simulation, statistical modeling, data visualization, machine learning, and much more.
AQDC will use JupyterHub to serve Jupyter Notebooks to our users. JupyterHub spawns individual notebooks for each user and has security to ensure that a user can only access their own notebook.