Skip to main content

Manually invoking ingestion from an AWS S3 bucket

Ingestion of robolog metadata can either be triggered manually by POST request to our /api/ingest/v1/trigger endpoint, or automatically by registering your bucket with us as outlined in Automating Ingestion. While our recommendation is for you to create a workflow that enables automatic ingestion, it is important that you also know how to manually trigger ingestion.

Step 1. Determine the robolog type​

Model-Prime currently supports ingestion of a variety of robolog types. We'll assume use of a ROSBag2 log type for this example.

Step 2. Determine the file location for the metadata.​

For manual ingestion to work, you will need to make a POST request to our /api/ingest/v1/trigger endpoint with the following information:

  • The AWS Account ID for the owner of the bucket
  • The log type
  • The location of the metadata file to be ingested

For this example, we will assume you have an AWS account ID of 123456789000 and you want to ingest metadata of the type ROSBag2 from a bucket named modelprime.example.bucket where the metadata is located at /robodata/d006b838-ee73-4430-bde3-2d308c64631d/metadata.yaml.

Step 3. Trigger the ingest manually​

In the Model-Prime web app, navigate to the Ingest Dashboard. Click on the widget that says "Manual Ingestion", select the "AWS S3" tab and fill in the required form fields.

Web App UI AWS S3 Manual Ingestion