Skip to main content

10.0-to-11.0

Please read this entire document before commencing an upgrade.

It is necessary to migrate Azul OpenSearch data to new prefixes as part of this release.

It is also NOT necessary to migrate Kafka data.

Required Changes​

Opensearch data is the only data that needs to be migrated for this release, incrementing the external.opensearch.partition number will achieve this. This supports entropy similarity and changes necessary to allow for direct download through the webui.

Removed Helm Char Values​

Retrohunt​

Removed as no longer needed now that it's integrated into Restapi.

  • plugins.retrohunt-server

Retrohunt worker options centeralised to external.redis

plugins: retrohunt-worker baseEnv: # modified extraContainers: worker: env: # modified content-indexer: env: # modified

New Helm Chart Values​

New setting for cleaning up retrohunts.

external.redis.cleanup_running_delay

This values was changed from ms to seconds

external.redis.cleanup_running_delay.ttl cleanup_running_delay (days to allow a retrohunt job to run) ttl (changed from ms to seconds)

Metastore​

Enables users to disable similar entropy (useful if there is something preventing Opensearch using the faiss plugin) By default it's false

metastore.plugin.disable_entropy_similarity

New download ingestor added to create status events for download events. Used for the new ability to download events via the UI. Also useful for tracking the status of download events.

metastore.instances.ingest-download

Recovery​

New setting to allow for two concurrent backups.

This setting is intended to allow admins to get two backups fully in sync and then switch over to the new backup and clear the old backup with no risk of being without a complete backup at all times.

recovery.nextBackupLabel

Restapi​

Added new header by default to prevent browser caching, as it was caching some streams which AVs would flag (yara rules)

restapi:
  additional_headers:
  Cache-Control: "no-store"

Min and max priority for Caveats can now be configured.

restapi
  labels:
    caveat:
      options:
	  - name: EXAMPLE_CAVEAT
	    min_priority: "0"
  		max_priority: "1000"

Plugins​

enableLivenessProbe is a boolean that defaults to true, the probe can be disabled using something like this:

plugins:
  generic:
    type: standard
    enabled: true
    plugins:
      alphabets:
        enableLivenessProbe: false

New plugin jadx added to generic plugins section