Amazon S3 File structure for SM-AFE

1. What is SM-AFE
Semantic maps auto feature extraction. This job will automatically extract geofeatures of
one point cloud trip, the result will be stored in MongoDB. The user can view the
geofeatures of the map using UPE’s Mapper tool.

2. Files generated in AFE process

a. Temporary files:
i. AFE will download a des config using a store_id. The des config will then
be splitted into several des config files, each has a different start and end
time.
ii. In Map command, there are geojson result files generated if geo-features
are extracted. Those geojson result files will later be used as a input of
feature aggregation.
b. Permanent files:
i. Geo-features groundtruth: these files are retrieved from the manually
tagged map. Currently these maps has groundtruth data: Startx, Marin,
Sandhill, MBZ and CES.
ii. Result files: final result of geo-feature output and kpi result will be stored.
3. File structure:
● Cm-persistent
○ Store_id
■ Afejobs
■ geofeature_groundtruth
Groundtruth in both Lat and UTM.
■ Uuid
● Des_collection
Temp des files
● Output_collection
Result files
● Geojson_result
Temp geojson files
Example：
Check this:
https://s3.console.aws.amazon.com/s3/buckets/cm-persistent/4ec83260899e63e775940983ec2
a06735671e395/afejobs/?region=us-west-2&tab=overview