Feeding Storages

TODO Marius

Storage Types

• database
• elastic

Database

Elastic

{
  "feedingStorages": {
    "elastic": {
      "endpoint": "http://my-elastic-host:9200"
    }
  }
}

Aliases

• update - writing events
• fullfeed - writing events
• data - read the data

Use Case (Delete document by id from history)

• delete the document from data alias

Use Case (Ignore document in history)

• set the operation to ignore - use data alias

Use Case (Unignore document in history)

• set the operation that was stored in operationBackup - use data alias

Use Case (Refeed a document by id)

• read the document by the id (use data alias)
• write the document to the queue

Use Case (Purge History)

• create a new index
• set alias data, update to the new index
• delete the old index

Use case - Fullfeed:

• fullfeed start
  • a new feeding index is created
  • alias: fullfeed
• send bulk data
  • the data is sent to fullfeed (check if fullfeed exists) and update alias
• fullfeed end
  • update alias is switched
  • data alias is switched
  • fullfeed alias is removed
• Run job (Reindex)
  • read the documents from data alias

Use case - Update:

• send bulk data
  • the data is sent to fullfeed (check if fullfeed exists) and update alias

Use Case (Reindex):

• run job (Reindex)
  • read the documents from data alias

Use Case (Cancel Fullfeed)

• fullfeed cancel
  • the fullfeed index is deleted and the fullfeed alias is deleted