Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Skim variables input checker #873

Open
jpn-- opened this issue May 22, 2024 · 0 comments
Open

Skim variables input checker #873

jpn-- opened this issue May 22, 2024 · 0 comments
Assignees
Labels
Feature New feature or request

Comments

@jpn--
Copy link
Member

jpn-- commented May 22, 2024

The SkimDataset structure requires every variable to have a unique name. It also merges OMX variables based on time period, so that e.g. BIKETIME__AM and BIKETIME__PM, which would be 2-d arrays in the OMX file, become just two different parts of a 3-d array called BIKETIME in the SkimDataset.

This is problematic when the skims also contain a 2-d array called BIKETIME, as that has no temporal dimension, and it gets loaded into a 2-d array in the SkimDataset, with the same name as the 3-d array, and thus one is overwritten and lost.

A workaround has been added via the omx_ignore_patterns setting in #867, which allows the user to not load certain skims, but this relies on the model developer or user to set this up correctly.

Describe the solution you'd like
We need the input checker to identify this overwriting condition and raise an error if it is happening, so that the user can correct the condition via (1) the omx_ignore_patterns setting, (2) revising the skim generation process to not create the overlapping named skims in the file in the first place, or (3) renaming one or both skims if the users actually wants both skims variables in the model.

@jpn-- jpn-- added the Feature New feature or request label May 22, 2024
@dhensle dhensle added this to Phase 10A Oct 1, 2024
@dhensle dhensle mentioned this issue Oct 1, 2024
3 tasks
@jpn-- jpn-- moved this to Short List in Phase 10A Nov 5, 2024
@jpn-- jpn-- self-assigned this Nov 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature New feature or request
Projects
Status: Short List
Development

No branches or pull requests

2 participants