feat: Add use_identity_overrides_in_local_eval setting

[kyle-ssg]

Thanks for submitting a PR! Please check the boxes below:

• I have added information to docs/ if required so people know about the feature!
• I have filled in the "Changes" section below?
• I have filled in the "How did you test this code" section below?
• I have used a Conventional Commit title for this Pull Request

Changes

How did you test this code?

Toggled setting

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
flagsmith-frontend-preview	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Sep 10, 2024 1:49pm
flagsmith-frontend-staging	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Sep 10, 2024 1:49pm

1 Skipped Deployment

Name	Status	Preview	Comments	Updated (UTC)
docs	⬜️ Ignored (Inspect)			Sep 10, 2024 1:49pm

[github-actions]

Docker builds report

Image	Build Status	Security report
ghcr.io/flagsmith/flagsmith-e2e:pr-4612	Finished ✅	Skipped
ghcr.io/flagsmith/flagsmith-api-test:pr-4612	Finished ✅	Skipped
ghcr.io/flagsmith/flagsmith:pr-4612	Finished ✅	Results ✅
ghcr.io/flagsmith/flagsmith-private-cloud:pr-4612	Finished ✅	Results ✅
ghcr.io/flagsmith/flagsmith-api:pr-4612	Finished ✅	Results ✅
ghcr.io/flagsmith/flagsmith-frontend:pr-4612	Finished ✅	Results ✅
ghcr.io/flagsmith/flagsmith-frontend:pr-4612	Finished ✅	Results ✅
ghcr.io/flagsmith/flagsmith:pr-4612	Finished ✅	Results ✅
ghcr.io/flagsmith/flagsmith-private-cloud:pr-4612	Finished ✅	Results ✅

[github-actions]

Uffizzi Preview deployment-56096 was deleted.

[rolodato]

Other than that looks good, but I'd like to have some explanation on why users would want to have this enabled or not. There are also docs like https://docs.flagsmith.com/clients/#local-evaluation-1 that need to be updated to take into account this new setting, but we can add this in a different PR

[kyle-ssg]

Good question as to why they'd want this enabled or not, I get the feeling that we'd start enabling this by default @gagantrivedi ?

The only reason I see this being useful as an option is if a project uses flags on the backend and frontend and want to reserve identity overrides for just development and never want it hitting their backend.

[gagantrivedi]

Good question as to why they'd want this enabled or not, I get the feeling that we'd start enabling this by default @gagantrivedi ?

The only reason I see this being useful as an option is if a project uses flags on the backend and frontend and want to reserve identity overrides for just development and never want it hitting their backend.

The reasoning is captured here https://flagsmith.slack.com/archives/CTF0THS2D/p1725270568904189?thread_ts=1724865246.072169&cid=CTF0THS2D

[kyle-ssg]

Ok yep, bringing here for visibility

This will mean that a release on our side might (probably will) change the value for flags in our customer’s environments. I actually think this should be an opt in flag on the environment, defaulted to true for all new environments, but off for any
existing ones.

So essentially this is to avoid any unexpected changes

[kyle-ssg]

@rolodato based on this, should we just have a small note somewhere on this rather than having it be too prominent in docs ?

[rolodato]

Let's merge this as-is and improve the docs later. Getting more people onboarded to this is more important than having perfect docs.

We'd need to share more detailed context in the docs by explaining that this is only for SaaS, was/will be enabled by default for all new environments since a specific Flagsmith version - too much to fit in a small note IMO.

[flagsmith]

Flagsmith feature linked: use_identity_overrides_in_local_eval
Default Values:

Environment	Enabled	Value	Last Updated (UTC)
Production	✅ Enabled		2024-09-10 13:32:43
Staging	✅ Enabled		2024-09-10 13:32:32
Demo	❌ Disabled		2024-09-10 13:28:59
Self hosted defaults	❌ Disabled		2024-09-10 13:28:59

[sentry-io]

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

• ‼️ TypeError: Cannot read properties of undefined (reading 'use_identity_overrides_in_local_eval') apply(web/components/pages/EnvironmentSettingsP... View Issue

_{Did you find this useful? React with a 👍 or 👎}

[flagsmith]

Flagsmith Feature use_identity_overrides_in_local_eval has been updated:

Environment	Enabled	Value	Last Updated (UTC)
Demo	✅ Enabled		2024-09-24 16:35:13