Yes! You can automate your dataset to be regularly updated by using one of our integration options. For example, your organization may have an internal database with constantly updating information that you want to be reflected in your open data portal.
Datasets can vary in file size depending on the number of rows, columns, format, etc. The Data & Insights platform can host both small and large datasets, but the method of importing a dataset will depend on file size.
For datasets less than 4GB it is possible to import them through any of our import methods some of which can be found here. However, if the dataset you wish you import is larger than 4GB please let us know by contacting support at firstname.lastname@example.org so we can help make the upload process as smooth as possible.
It is currently not possible to import multiple files at once through the web interface. To import multiple files you would need to program a solution using the publisher API.
When you receive an error during import, it usually means you need to make some small changes or adjustments to your data or settings. Please contact email@example.com and we will help you determine why the file is not importing.
ETL stands for extract, transform, and load. This refers to the process data goes through to make integration possible between systems. For example, the integration between an excel document on your desktop and the dataset on your Data & Insights platform.
Site Publishers and Admins can review the Activity Log page in the admin section of your site. You can read more about the options available on this page in our article on the Activity Log.
When importing data, Data & Insights will automatically detect if your file can be parsed and uploaded in a tabular format. In the case that the file is non-parsable, it will be uploaded as a "File and Documents" asset that can only be previewed and downloaded by a user.
If you think your data should be parsed as tabular data and it is not, it is because your file does not have an extension listed in the supported 'parseable file formats' on the upload page. Currently, the supported parseable file formats are: .csv, .tsv, .xls, .xlsx, .zip (shapefile), .json (GeoJSON only), .geojson, .kml, .kmz.
As listed above .json files are only parseable as geojson files, standard .json files will not be parsed during import.