Adapt color temperature, not brightness for individual light

[Kuchiru]

So for some motion/occupancy triggered areas i dim lights instead of turning them off, i only do this at specific light levels to keep an ambiance in the house rather than staring into dark areas i like them to feel inviting.
When i enter the area again i trigger the light to adapt with adaptive_lighting.apply which fades in beautifully.

The issue i'm having is, adaptive lighting will not keep adapting the color temperature of the light with a manually set brightness, disabling manual control will also adjust the brightness. is there a way to get the desired behavior without creating an adaptive lighting instance solely for this light?

[Kuchiru]

I ended up creating an instance for one light, thing is that even though im finding some things to be finicky.

For example:
I turn off the switch Adapt Brightness
I turn the brightness to 1%
Success, the color still adapts.
I want to adapt the brightness again
Turn on the switch to adapt brightness - no immediate response (this seems to only happen when adaptive lighting has a 'tick' to adjust the lights, so this can take a little while)
Use adaptive lighting apply with the adapt brightness setting on - nothing happens, light remains 1%

Other scenario:
Turn light to 1% brightness
Fail, light will not adapt color
However, setting manual control off for the light will immediately adapt the brightness and the color.

Any other ideas?