Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Futures and Future Options file-based universes #8480

Open
wants to merge 49 commits into
base: master
Choose a base branch
from

Conversation

jhonabreul
Copy link
Collaborator

@jhonabreul jhonabreul commented Dec 24, 2024

Description

Algorithms with changed stats:

The way now futures and fops selection happens just changed the times at which orders are being placed.
Also, data points count is reduced the same way as with #8212 and history data points is increased in some algorithms due to history requests being made for getting futures and future options chains.

GC map file added data:

Needed for FutureOptionMultipleContractsInDifferentContractMonthsWithSameUnderlyingFutureRegressionAlgorithm since there was no mapping data for the algorithm's date range. Now it is needed in order for the SubscriptionDataReader to be able to get a tradable date and read FutureUniverse files.

Benchmarks

Single Future, selecting all contracts and adding options for each contract:

This benchmark tests selection only, since options are loaded but not selected, so no market data is loaded for options:

SetStartDate(2018, 1, 1);
SetEndDate(2025, 1, 1);

UniverseSettings.Asynchronous = true;
UniverseSettings.Resolution = Resolution.Daily;

var future = AddFuture("GC", Resolution.Daily);
future.SetFilter(u => u);
AddFutureOption(future.Symbol, u => u.Contracts(x => x.Take(0)));

The algorithm only runs for 6 months and is stopped using Quit()

Master: ~21s (on average)
Branch: ~2.15s

This next benchmark is the same as the one above, but uses 6 futures instead on a single one. The algorithm only runs for 2 months and is stopped using Quit()

SetStartDate(2018, 01, 01);
SetEndDate(2025, 01, 01);

UniverseSettings.Asynchronous = true;
UniverseSettings.Resolution = Resolution.Daily;

var tickers = new[] { "GC", "ES", "ZC", "NQ", "VX", "SI" };
foreach (var ticker in tickers)
{
    var future = AddFuture(ticker, Resolution.Daily);
    future.SetFilter(u => u);
    AddFutureOption(future.Symbol, u => u.Contracts(x => x.Take(0)));
}

Master: ~44.2s
Branch: ~3.16s

Related Issue

Closes #6861
Closes #4821
Closes #8370

Motivation and Context

Requires Documentation Change

How Has This Been Tested?

  • Exisiting regression algorithms and unit tests.
  • New regression algorithms and unit tests.

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • Refactor (non-breaking change which improves implementation)
  • Performance (non-breaking change which improves performance. Please add associated performance test and results)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Non-functional change (xml comments/documentation/etc)

Checklist:

  • My code follows the code style of this project.
  • I have read the CONTRIBUTING document.
  • I have added tests to cover my changes.
  • All new and existing tests passed.
  • My branch follows the naming convention bug-<issue#>-<description> or feature-<issue#>-<description>

Also refactor future chain provider to use the new FutureUniverse instead of zip file names
Also, remove IDerivativeSecurity interface from Future
Modified algorithms to use futures contract objects directly instead of accessing their Symbol property.
Removed unnecessary import statements and redundant lines in various files.
- Added `AddData` method to `BaseChain` for adding market data
- Refactored `TimeSliceFactory` to use `BaseChain.AddData` method
Removed public indexers in `BaseChains` for getting or setting `BaseChain` instances by `ticker` or `Symbol`, which were used for Pythonnet compatibility.
Renamed `FileBasedUniverse` to `BaseChainUniverseData` and
`IFileBasedUniverse` to `IChainUniverseData`.
- Introduced `BaseContract` as an abstract base class for contracts, consolidating common properties and methods.
- Removed ISymbolInterface
Removed ZipEntryName class and references across various files.
Removed DataQueueFuturesChainUniverseDataCollectionEnumerator and DataQueueOptionChainUniverseDataCollectionEnumerator classes.
Removed OptionChainUniverseSubscriptionEnumeratorFactory class.
Removed unused code for handling OptionChainUniverse and FuturesChainUniverse in FileSystemDataFeed.cs and LiveTradingDataFeed.cs.
Removed several test files related to enumerator factories and universe data collection.
Forward price data from bars and ticks stored in private fields for improved memory usage
Added HSI futures universe files
Internals go first
Future options IV, Open interest and greeks are not supported for future options
@jhonabreul jhonabreul force-pushed the feature-fops-universe-files branch from aba9f13 to d00ff8e Compare January 17, 2025 21:19
Copy link
Member

@Martin-Molinero Martin-Molinero left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work! 🚀

Removed greeks and IV columns.
Updated FOPs universe files: removed outdated columns.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants