Aleph custom schemata

Hi o/

We use Aleph as the first level of capitalization for all our investigation. We ingest automatically a large number of documents that came from several sources. We need a way to add specific metadata for each sources.

Is there a way in Aleph (or maybe in the near future) to add custom FtM schema for Documents, Folders, etc ?
Is those metadata can be shown in the UI ?

For example, we need to add the TLP marking for most of our documents.

I try to make custom FtM schema but when ingesting, Aleph don’t seem to take my custom schema.

Thanks!

Hey, extending the schema is documented here: Schema Extensions – FollowTheMoney

The UI will display new properties automatically.

But it is not really recommended to extend the schema wildly, because you would introduce backwards-incompatible changes and would need to keep the original FtM in sync with your customized schema.

Good luck :slight_smile:

Also, here are instructions on how to load a custom model in Aleph. However, Simon’s note of caution still applies :slight_smile:

I just follow the document I created a custom schema that is a fork of “Document” with several added properties. The problem is that Aleph uses hard coded value in the Document class.

The schema type can be any of Folder, Table or Document (here: github code)

Did you modify the original scheme or is there a way to ingest a document with a custom schema ?

Another problem is that even if we modify the default scheme (for exemple Document.yaml. Your validation schema DocumentIngest need to be modified to be able to set those new custom properties using the ingest api (I think ?).

Here: github code

That’s correct, also see FEATURE: Ingest API endpoint should accept `Document` properties · Issue #3272 · alephdata/aleph · GitHub. The only workaround I can think of right now is to update the Document entity after ingesting it.

1 Like

Is the fix to this issue is planned at short term ?

Unfortunately we don’t have the bandwidth to work on this now, but we may help anyone who would like to contribute this change to ingest-file.

1 Like