Managing Datasets

Managing Datasets

Whether adding data layers to display within Aware, Siting, or Map Site Views, or uploading data layers to be included in the algorithm for your Route PLAE, it all starts with adding a dataset here.

While users can add KML reference data layers to view on the map within Aware, Siting, and Route, adding a dataset via this process will create a permanent dataset layer, stored by Pivvot, accessed only by your team, and updated and maintained by you and your team (with requisite access permissions).

On the Dataset Console landing page, you will notice options for 1-4 in the pic below. Once you click on any of the datasets listed in the Search panel, or when you right click on any of the datasets, you will see the additional options for 5-8 in the pic below.

1. New Dataset

There are two options when creating datasets.

• For users with Pivvot's Site View product only: Quickest way to view data in a site view! - This option is the quickest path to making new data visible in a site view. Using the Processing Options during Create Dataset the user can optionally have the system create a layer for each uploaded dataset and add these layers to a new or existing site view. If the preset setup option is chosen, all layers are initially set up with default styles. The layer styles can then be modified in the Layer Console.
• For all other users: Upload the dataset(s) and once they are complete, manually create layers within the Layer Console. See directions below.

Follow these steps to create a dataset:

1. Open the Dataset Console.
2. At the top right; select the New Dataset icon.
3. Upload the files by dragging and dropping directly into the box or by browsing (note: only zipped Esri file geodatabases created with ArcGIS 10.0 or above can be uploaded into Publish. File size must not exceed 50 MB).
4. Click the Upload button.
5. Check the boxes of the feature classes to be uploaded.
   1. IMPORTANT: only three (3) feature classes can be uploaded at a time. The Dataset Console will "remember" your uploaded geodatabase for three hours from when you first uploaded, so that you can simply go back to your dataset to continue to add feature classes, without having to re-upload your geodatabase file.
6. Create a unique dataset name. We recommend planning your naming strategy. This will help locate common datasets within Publish. This same strategy should be used for Layers and Reports. For example; use a prefix that contains a project name and then the asset name (i.e. projectname_roads) for all datasets participating in a project.
7. Optional:
   1. Choose to include a "Prefix" or "Suffix" into your dataset names. Anything listed in Prefix or Suffix will apply to all your feature classes.
   2. Toggle the "Configure Default Layer" on if you want to use the Pivvot defined symbology for points, lines and polygons. (see Quickest way to view data in a site view! for more details)
   3. Toggle the "Publish to a Site View" if you wish to add the dataset to one of your Site Views. Note: Pivvot Site View product required to use this function. (see Quickest way to view data in a site view! for more details)
8. Click Create.
9. You can track the upload status of your new Dataset via the Dataset Console. When the Status column displays a green check, your dataset is ready.

Follow the steps below to complete configuration of your dataset.

1. Locate the dataset in the list of datasets within the Dataset Console.
2. Right-click the dataset > Edit Dataset OR click on the dataset > select Edit Dataset icon at the top right.
3. You will see three options to which you can make your edits.
   1. Setup: This is where you can edit the display name for your dataset.
   2. Fields: These are the attributes that you can make available to users. These fields will display to users when a search is conducted within the Pivvot platform. Any attributes contained within your Geodatabase file will be displayed here. You can also add additional fields. Select the field. Add/Edit the name (no spaces). Then select field type. In addition to text, date, and integer fields, users can create a field for a link and populate it with a URL. You can also delete fields by selecting the trash bin icon next to each listed field.
   3. Search: Set how the datasets and fields will display in the Pivvot platform when a search is conducted. Here you can edit/change display names, check the box to display a field as a link, or change the order of listed fields by clicking and dragging them up/down.
4. Be sure to click Save to save all your changes.
5. Create a layer for this dataset via the Layer Console. 

2. New Empty Dataset

Creating a New Empty Dataset is almost identical to creating a New Dataset. The difference is that with a New Empty Dataset you will not upload any files. Instead, you create a blank, empty, dataset. You decide if the dataset will be a point, line, or polygon, and you create all the fields.

1. Open the Dataset Console.
2. Click the New Empty Dataset button, located on the top right of the screen.
3. Follow instructions for Follow the steps below to complete configuration of your dataset.
4. Be sure to click Save to save all your changes.

3. New Fulcrum Dataset

Pivvot has a partnership with Fulcrum that allows easy integration of your Fulcrum field data directly into the Pivvot platform. Fulcrum is a data collection company that leverages advanced GIS and AI data collection capabilities to boost productivity, deliver real-time data insights, and drive adoption by both field and office teams.

1. Open the Dataset Console.
2. Click the New Fulcrum Dataset button, located on the top right of the screen.
3. Enter your Fulcrum API Key. Provided by Fulcrum.
4. Select Fulcrum form name to be used.
5. Create a unique dataset name. We recommend planning your naming strategy. This will help locate common datasets within Publish. This same strategy should be used for Layers and Reports. For example; use a prefix that contains a project name and then the asset name (i.e. projectname_roads) for all datasets participating in a project.
6. Toggle on/off the Processing options to "Configure Default Layer" and "Publish to a Site View." (see Quickest way to view data in a site view! for more details)
7. Click the Ingest button.
8. You can track the upload status of your new Dataset via the Dataset Console. When the Status column displays a green check, your dataset is ready.
9. Once your Fulcrum dataset is ready, follow instructions for Follow the steps below to complete configuration of your dataset.

4. Update Dataset - Multiple

To keep the information in Pivvot current, you will periodically need to update your datasets. Updates are a rip and replace; meaning the records in a dataset will be completely replaced with the updated information.

You will be warned if a column that is being used to configure a Layer, Report, or Search is not available in the updated information.

1. Open the Dataset Console.
2. Click the Update Datasets button, located on the top right of the screen.
3. Locate the file that contains the updated information.
4. From the Available feature classes; choose the feature classes which will participate in the update.
5. From the Dataset name column; choose the corresponding dataset to be updated.
6. Click the Update button.

5. Duplicate Dataset Config

To save time when creating a New Empty Dataset, users can use the setup/configuration of a currently existing dataset to generate a new one. 

1. Open the Dataset Console.
2. Right-click the dataset > Duplicate Dataset Config OR click on the dataset > select Duplicate Dataset Config icon at the top right.
3. You will see three options to which you can make your edits. Follow instructions for Follow the steps below to complete configuration of your dataset. 
   1. Setup
   2. Fields
   3. Search
4. Be sure to click Save to save all your changes.

6. Update Dataset - Single

To keep the information in Pivvot current, you will periodically need to update your dataset. Updates are a rip and replace; meaning the records in a dataset will be completely replaced with the updated information.

You will be warned if a column that is being used to configure a Layer, Report, or Search is not available in the updated information.

1. Open the Dataset Console.
2. Locate the dataset in the list.
3. Right-click the dataset > Update Dataset OR click on the dataset > select Update Dataset icon at the top right.
4. Upload the file you wish to use to update your dataset by dragging and dropping directly into the box or by browsing (note: only zipped Esri file geodatabases created with ArcGIS 10.0 or above can be uploaded into Publish. File size must not exceed 50 MB).
5. Click the Update button.

7. Edit Dataset

1. Locate the dataset in the list of datasets within the Dataset Console.
2. Right-click the dataset > Edit Dataset OR click on the dataset > select Edit Dataset icon at the top right.
3. You will see three options to which you can make your edits. Follow instructions for Follow the steps below to complete configuration of your dataset. 
   1. Setup
   2. Fields
   3. Search
4. Be sure to click Save to save all your changes.

8. Delete Dataset

1. Open the Dataset Console.
2. Locate the dataset in the list.
3. Right-click the dataset > Delete Dataset OR click on the dataset > select Delete Dataset icon at the top right.
4. Confirm Delete.