How to load extensions ? (druid)

[chrecht]

Hi,

I hope you may help me. I've tried now every possibility to use the "configOvverrides" to load additionnel extensions, but they are not reflected in the configmap.

Is this not implemented by the operator or am I using this the wrong way? :)

  brokers:
    configOverrides:
      runtime.properties:
        druid.extensions.loadList: '"[ \"druid-basic-security\", \"prometheus-emitter\", \"druid-kafka-indexing-service\", \"druid-parquet-extensions\", \"druid-histogram\", \"druid-datasketches\", \"druid-lookups-cached-global\", \"druid-hdfs-storage\", \"druid-opa-authorizer\", \"postgresql-metadata-storage\", \"druid-multi-stage-query\", \"druid-s3-extensions\", \"druid-moving-average-query\" ]"'
    roleGroups:
      default:
        replicas: 1

Thank you for your advice,
Christian

[lfrancke]

Hi Christian,

thanks for reporting this. @maltesander had a quick look earlier and this looks like a bug on our side. It looks like we override extensions :(
We'll take a detailed look next week and will investigate and create an issue if needed.

Thanks and have a great weekend!

[jfnormandtd]

Hi,

Is there any way we can still override the loadList ? (With another method than the configOverrides)

Thanks

[soenkeliebau]

I'm afraid with "normal" methods there is no way to do this.
If a hacky way is ok and you just need something up to play around with for the weekend you could manually edit the configmap.

You'll need to scale the druid operator deployment to 0 replicas, so the operator doesn't revert your manual changes immediately. Then edit the broker configmap and restart the broker sts.

Not pretty but depending on your needs might get it done for now.

[chrecht]

Hi,

ok I see :) Are there any future plans to add this possibility to load more extensions ? :)

Have a great day,
Christian

[soenkeliebau]

Absolutely! We'll also definitely look at the overrides, as that should work.

There are just too many settings in these components for us to expose all of them at once, we are constantly evaluating which ones make sense to expose directly though, and direct feedback like in this case from you always goes to the top of the list!

[chrecht]

Thank you very much ❤️

[lfrancke]

We're tracking this here now: stackabletech/druid-operator#381

[lfrancke]

This is fixed in nightly now and will be included in the next release which is scheduled for April (sorry, we just had our last release two weeks ago).

If you need help in the meantime let us know. We are building nightly images as well so you should be able to use those!

[soenkeliebau]

There is also stackabletech/druid-operator#416 which will make this easier once discussed and merged.