Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ClientAndServer_OneOrBothUseDefault_Ok - fails with NullReferenceException #2353

Closed
ViktorHofer opened this issue Oct 21, 2019 · 10 comments
Closed

ClientAndServer_OneOrBothUseDefault_Ok - fails with NullReferenceException #2353

ViktorHofer opened this issue Oct 21, 2019 · 10 comments
Assignees
@aik-jahoda
Labels
area-System.Net.Security blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' bug os-windows tenet-reliability Reliability/stability related issue (stress, load problems, etc.) test-run-core Test failures in .NET Core test runs
Milestone
6.0.0

Comments

@ViktorHofer
Copy link
Member

ViktorHofer commented Oct 21, 2019 •
edited by jaredpar
Loading

https://dnceng.visualstudio.com/public/_build/results?buildId=395007&view=ms.vss-test-web.build-test-results-tab&runId=12313218&resultId=165447&paneView=debug

Configuration: System.NullReferenceException : Object reference not set to an instance of an object.

System.NullReferenceException : Object reference not set to an instance of an object.
  at System.Net.Security.SslSessionsCache.CacheCredential(SafeFreeCredentials creds, Byte[] thumbPrint, SslProtocols sslProtocols, Boolean isServer, EncryptionPolicy encryptionPolicy) in /_/src/System.Net.Security/src/System/Net/Security/SslSessionsCache.cs:line 199
   at System.Net.Security.SecureChannel.GenerateToken(Byte[] input, Int32 offset, Int32 count, Byte[]& output) in /_/src/System.Net.Security/src/System/Net/Security/SecureChannel.cs:line 843
   at System.Net.Security.SecureChannel.NextMessage(Byte[] incoming, Int32 offset, Int32 count) in /_/src/System.Net.Security/src/System/Net/Security/SecureChannel.cs:line 735
   at System.Net.Security.SslStream.StartSendBlob(Byte[] incoming, Int32 count, AsyncProtocolRequest asyncRequest) in /_/src/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 447
   at System.Net.Security.SslStream.ProcessReceivedBlob(Byte[] buffer, Int32 count, AsyncProtocolRequest asyncRequest) in /_/src/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 663
   at System.Net.Security.SslStream.StartReadFrame(Byte[] buffer, Int32 readBytes, AsyncProtocolRequest asyncRequest) in /_/src/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 617
   at System.Net.Security.SslStream.PartialFrameCallback(AsyncProtocolRequest asyncRequest) in /_/src/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 798
--- End of stack trace from previous location ---
   at System.Net.Security.SslStream.<ThrowIfExceptional>g__ThrowExceptional|141_0(ExceptionDispatchInfo e) in /_/src/System.Net.Security/src/System/Net/Security/SslStream.cs:line 844
   at System.Net.Security.SslStream.ThrowIfExceptional() in /_/src/System.Net.Security/src/System/Net/Security/SslStream.cs:line 845
   at System.Net.Security.SslStream.InternalEndProcessAuthentication(LazyAsyncResult lazyResult) in /_/src/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 440
   at System.Net.Security.SslStream.EndProcessAuthentication(IAsyncResult result) in /_/src/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 411
   at System.Net.Security.SslStream.EndAuthenticateAsClient(IAsyncResult asyncResult) in /_/src/System.Net.Security/src/System/Net/Security/SslStream.cs:line 241
   at System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic(IAsyncResult iar, Func`2 endFunction, Action`1 endAction, Task`1 promise, Boolean requiresSynchronization) in /_/src/System.Private.CoreLib/shared/System/Threading/Tasks/FutureFactory.cs:line 513
--- End of stack trace from previous location ---
   at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks) in /_/src/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs:line 83
   at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks) in /_/src/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs:line 111
   at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks, Int32 millisecondsTimeout) in /_/src/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs:line 71
   at System.Net.Security.Tests.SslStreamSystemDefaultTest.ClientAndServer_OneOrBothUseDefault_Ok(Nullable`1 clientProtocols, Nullable`1 serverProtocols) in /_/src/System.Net.Security/tests/FunctionalTests/SslStreamSystemDefaultsTest.cs:line 63
--- End of stack trace from previous location ---

cc @davidsh, @wfurt, @scalablecory, @eiriktsarpalis, @karelz

Runfo Tracking Issue: Runtime test ClientAndServer_OneOrBothUseDefault_Ok

Build Definition Kind Run Name Console Core Dump Test Results Run Client
1254354 runtime PR 55298 net6.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Client21H1.Open console.log runclient.py
1254354 runtime PR 55298 net6.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Client21H1.Open console.log runclient.py
1254354 runtime PR 55298 net6.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Client21H1.Open console.log runclient.py
1254354 runtime PR 55298 net6.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Client21H1.Open console.log runclient.py
1254354 runtime PR 55298 net6.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Client21H1.Open console.log runclient.py
1254354 runtime PR 55298 net6.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Client21H1.Open console.log runclient.py
1254354 runtime PR 55298 net6.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Client21H1.Open console.log runclient.py
1254354 runtime PR 55298 net6.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Client21H1.Open console.log runclient.py
1254354 runtime PR 55298 net6.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Client21H1.Open console.log runclient.py

Build Result Summary

Day Hit Count Week Hit Count Month Hit Count
0 0 1
@karelz
Copy link
Member

karelz commented Dec 5, 2019

Triage: @davidsh thinks we have a bug SslSessionCache (long existing probably)

@wfurt wfurt transferred this issue from dotnet/corefx Jan 29, 2020
@Dotnet-GitSync-Bot Dotnet-GitSync-Bot added area-System.Net.Security untriaged New issue has not been triaged by the area owner labels Jan 29, 2020
@wfurt wfurt added os-windows test-run-core Test failures in .NET Core test runs labels Jan 29, 2020
@wfurt wfurt added this to the 5.0 milestone Jan 29, 2020
@wfurt
Copy link
Member

wfurt commented Jan 29, 2020

I see ~ 3K failures in the last 90 days - all on Windows failing for few different reasons.
#2352 is probably the same root cause.

@karelz karelz removed the untriaged New issue has not been triaged by the area owner label Feb 13, 2020
@karelz karelz changed the title System.Net.Security.Tests.ApmSslStreamSystemDefaultTest.ClientAndServer_OneOrBothUseDefault_Ok(clientProtocols: Tls | Tls11 | Tls12, serverProtocols: null) test failing in CI with NullReferenceException ClientAndServer_OneOrBothUseDefault_Ok- fails with NullReferenceException Apr 3, 2020
@karelz karelz changed the title ClientAndServer_OneOrBothUseDefault_Ok- fails with NullReferenceException ClientAndServer_OneOrBothUseDefault_Ok - fails with NullReferenceException Apr 3, 2020
@karelz karelz added bug tenet-reliability Reliability/stability related issue (stress, load problems, etc.) labels May 7, 2020
@karelz
Copy link
Member

karelz commented May 7, 2020

@wfurt thinks it is related/duplicate also to failures in #34337 and #30724 ... and to #2352 mentioned above.

@aik-jahoda aik-jahoda self-assigned this May 11, 2020
@aik-jahoda
Copy link
Contributor

aik-jahoda commented May 12, 2020 •
edited
Loading

Running Kusto query from 1/14/2020 to 5/12/2020 shows only one case of this failure (2020-03-17T17:40:41.813Z). The failure was accompanied by the same bug as in #34337.
The WorkItem result for this failure: https://helix.dot.net/api/2019-06-17/jobs/8f4028f3-d56e-41c0-a6ac-75d47b6822a4/workitems/System.Net.Security.Tests

Attached work item 
{
    "FailureReason": null,
    "Id": "966cf597-751e-4a13-8a04-a17cbe8447f5",
    "MachineName": "b0019YD",
    "ExitCode": 1,
    "ConsoleOutputUri": "https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-33664-merge-8f4028f3d56e41c0a6/System.Net.Security.Tests/console.d8ff6a0a.log?sv=2019-02-02&se=2020-03-27T17%3A40%3A39Z&sr=c&sp=rl&sig=l46%2FAiVg6wAfXn7BU73gFoVp%2B0cif3PR%2BnvfwL%2BQVD0%3D",
    "Errors": [],
    "Warnings": [],
    "Logs": [
        {
            "Module": "run_client.py",
            "Uri": "https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-33664-merge-8f4028f3d56e41c0a6/System.Net.Security.Tests/9e340d56-70ff-461e-92f2-9485ac2a09a4.log?sv=2019-02-02&se=2020-03-27T17%3A40%3A39Z&sr=c&sp=rl&sig=l46%2FAiVg6wAfXn7BU73gFoVp%2B0cif3PR%2BnvfwL%2BQVD0%3D"
        }
    ],
    "Files": [
        {
            "FileName": "testResults.xml",
            "Uri": "https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-33664-merge-8f4028f3d56e41c0a6/System.Net.Security.Tests/testResults.xml?sv=2019-02-02&se=2020-03-27T17%3A40%3A39Z&sr=c&sp=rl&sig=l46%2FAiVg6wAfXn7BU73gFoVp%2B0cif3PR%2BnvfwL%2BQVD0%3D"
        },
        {
            "FileName": "console.d8ff6a0a.log",
            "Uri": "https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-33664-merge-8f4028f3d56e41c0a6/System.Net.Security.Tests/console.d8ff6a0a.log?sv=2019-02-02&se=2020-03-27T17%3A40%3A39Z&sr=c&sp=rl&sig=l46%2FAiVg6wAfXn7BU73gFoVp%2B0cif3PR%2BnvfwL%2BQVD0%3D"
        }
    ],
    "Analysis": {
        "xunit": {
            "ResultXmlUrl": "https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-33664-merge-8f4028f3d56e41c0a6/System.Net.Security.Tests/testResults.xml?sv=2019-02-02&se=2020-03-27T17%3A40%3A39Z&sr=c&sp=rl&sig=l46%2FAiVg6wAfXn7BU73gFoVp%2B0cif3PR%2BnvfwL%2BQVD0%3D",
            "Results": [
                {
                    "Name": "System.Net.Security.Tests.ApmSslStreamSystemDefaultTest.ClientAndServer_OneOrBothUseDefault_Ok(clientProtocols: Default, serverProtocols: Ssl2 | Default | Tls11 | Tls12)",
                    "Result": "Fail",
                    "FailureExceptionType": "System.ObjectDisposedException",
                    "FailureMessage": "System.ObjectDisposedException : Safe handle has been closed.\\r\\nObject name: 'SafeHandle'.",
                    "FailureStackTrace": "   at System.Runtime.InteropServices.SafeHandle.DangerousAddRef(Boolean& success) in /_/src/libraries/System.Private.CoreLib/src/System/Runtime/InteropServices/SafeHandle.cs:line 149\n   at System.Net.Security.SafeCredentialReference..ctor(SafeFreeCredentials target) in /_/src/libraries/Common/src/Interop/Windows/SspiCli/SecuritySafeHandles.cs:line 354\n   at System.Net.Security.SafeCredentialReference.CreateReference(SafeFreeCredentials target) in /_/src/libraries/Common/src/Interop/Windows/SspiCli/SecuritySafeHandles.cs:line 341\n   at System.Net.Security.SslSessionsCache.CacheCredential(SafeFreeCredentials creds, Byte[] thumbPrint, SslProtocols sslProtocols, Boolean isServer, EncryptionPolicy encryptionPolicy) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslSessionsCache.cs:line 201\n   at System.Net.Security.SecureChannel.GenerateToken(ReadOnlySpan`1 inputBuffer, Byte[]& output) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SecureChannel.cs:line 830\n   at System.Net.Security.SecureChannel.NextMessage(ReadOnlySpan`1 incomingBuffer) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SecureChannel.cs:line 734\n   at System.Net.Security.SslStream.ProcessBlob(Int32 frameSize) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 375\n   at System.Net.Security.SslStream.ReceiveBlobAsync[TIOAdapter](TIOAdapter adapter) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 342\n   at System.Net.Security.SslStream.ForceAuthenticationAsync[TIOAdapter](TIOAdapter adapter, Boolean receiveFirst, Byte[] reAuthenticationData, Boolean isApm) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 268\n   at System.Threading.Tasks.TaskToApm.End(IAsyncResult asyncResult) in /_/src/libraries/Common/src/System/Threading/Tasks/TaskToApm.cs:line 42\n   at System.Net.Security.SslStream.EndAuthenticateAsClient(IAsyncResult asyncResult) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.cs:line 233\n   at System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic(IAsyncResult iar, Func`2 endFunction, Action`1 endAction, Task`1 promise, Boolean requiresSynchronization) in /_/src/libraries/System.Private.CoreLib/src/System/Threading/Tasks/FutureFactory.cs:line 513\n--- End of stack trace from previous location ---\n   at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks) in /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs:line 83\n   at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks) in /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs:line 111\n   at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks, Int32 millisecondsTimeout) in /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs:line 71\n   at System.Net.Security.Tests.SslStreamSystemDefaultTest.ClientAndServer_OneOrBothUseDefault_Ok(Nullable`1 clientProtocols, Nullable`1 serverProtocols) in /_/src/libraries/System.Net.Security/tests/FunctionalTests/SslStreamSystemDefaultsTest.cs:line 60\n--- End of stack trace from previous location ---",
                    "Reason": "",
                    "Duration": 3619,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.ApmSslStreamSystemDefaultTest",
                    "Method": "ClientAndServer_OneOrBothUseDefault_Ok",
                    "Arguments": "clientProtocols: Default, serverProtocols: Ssl2 | Default | Tls11 | Tls12"
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_AllowOneOnOneSideTls13_Success",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicyAndTls13Supported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_AllowOneOnOneSideTls13_Success",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_AllowSameTwoOnBothSidesLessPreferredIsTls13_Success",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicySupported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_AllowSameTwoOnBothSidesLessPreferredIsTls13_Success",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_AllowSomeCipherSuitesWithNoEncryptionOption_Fails",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicySupported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_AllowSomeCipherSuitesWithNoEncryptionOption_Fails",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_AllowTwoOnBothSidesWithNoOverlapNonTls13_Fails",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicySupported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_AllowTwoOnBothSidesWithNoOverlapNonTls13_Fails",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_AllowTwoOnBothSidesWithSingleOverlapNonTls13_Success",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicySupported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_AllowTwoOnBothSidesWithSingleOverlapNonTls13_Success",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_AllowedCipherSuitesIncludesSubsetOfInput_Success",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicySupported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_AllowedCipherSuitesIncludesSubsetOfInput_Success",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_NothingAllowed_Fails",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicySupported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_NothingAllowed_Fails",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_OnlyNonTls13CipherSuiteAllowedButOtherSideDoesNotAllowIt_Fails",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicySupported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_OnlyNonTls13CipherSuiteAllowedButOtherSideDoesNotAllowIt_Fails",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_OnlyNonTls13CipherSuitesAllowedButChosenProtocolDoesNotAllowIt_Fails",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicySupported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_OnlyNonTls13CipherSuitesAllowedButChosenProtocolDoesNotAllowIt_Fails",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_OnlyTls13CipherSuiteAllowedButChosenProtocolsDoesNotAllowIt_Fails",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicyAndTls13Supported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_OnlyTls13CipherSuiteAllowedButChosenProtocolsDoesNotAllowIt_Fails",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_OnlyTls13CipherSuiteAllowedOtherSideDoesNotAllowTls13_Fails",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicyAndTls13Supported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_OnlyTls13CipherSuiteAllowedOtherSideDoesNotAllowTls13_Fails",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_ThreeCipherSuitesWithTwoOverlapping_Success",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicySupported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_ThreeCipherSuitesWithTwoOverlapping_Success",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_TwoCipherSuitesWithAllOverlapping_Success",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"CipherSuitesPolicySupported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "CipherSuitesPolicy_TwoCipherSuitesWithAllOverlapping_Success",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.NegotiatedCipherSuite_SslProtocolIsTls13_ShouldBeTls13",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"Tls13Supported\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "NegotiatedCipherSuite_SslProtocolIsTls13_ShouldBeTls13",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.NegotiatedCipherSuiteTest.Tls13IsSupported_GetValue_ReturnsTrue",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"IsKnownPlatformSupportingTls13\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.NegotiatedCipherSuiteTest",
                    "Method": "Tls13IsSupported_GetValue_ReturnsTrue",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.SslStreamEKUTest.SslStream_ClientEKUServerAuth_Fails",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"IsRootCertificateInstalled\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.SslStreamEKUTest",
                    "Method": "SslStream_ClientEKUServerAuth_Fails",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.SslStreamEKUTest.SslStream_NoEKUClientAuth_Ok",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"IsRootCertificateInstalled\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.SslStreamEKUTest",
                    "Method": "SslStream_NoEKUClientAuth_Ok",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.SslStreamEKUTest.SslStream_NoEKUServerAuth_Ok",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"IsRootCertificateInstalled\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.SslStreamEKUTest",
                    "Method": "SslStream_NoEKUServerAuth_Ok",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.SslStreamEKUTest.SslStream_SelfSignedClientEKUClientAuth_Ok",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"IsRootCertificateInstalled\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.SslStreamEKUTest",
                    "Method": "SslStream_SelfSignedClientEKUClientAuth_Ok",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.SslStreamEKUTest.SslStream_ServerEKUClientAuth_Fails",
                    "Result": "Skip",
                    "FailureExceptionType": "",
                    "FailureMessage": "",
                    "FailureStackTrace": "",
                    "Reason": "Condition(s) not met: \\\"IsRootCertificateInstalled\\\"",
                    "Duration": 0,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.SslStreamEKUTest",
                    "Method": "SslStream_ServerEKUClientAuth_Fails",
                    "Arguments": ""
                },
                {
                    "Name": "System.Net.Security.Tests.SyncSslStreamSystemDefaultTest.ClientAndServer_OneOrBothUseDefault_Ok(clientProtocols: Ssl2 | Default | Tls11 | Tls12, serverProtocols: Default)",
                    "Result": "Fail",
                    "FailureExceptionType": "System.NullReferenceException",
                    "FailureMessage": "System.NullReferenceException : Object reference not set to an instance of an object.",
                    "FailureStackTrace": "   at System.Net.Security.SslSessionsCache.CacheCredential(SafeFreeCredentials creds, Byte[] thumbPrint, SslProtocols sslProtocols, Boolean isServer, EncryptionPolicy encryptionPolicy) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslSessionsCache.cs:line 199\n   at System.Net.Security.SecureChannel.GenerateToken(ReadOnlySpan`1 inputBuffer, Byte[]& output) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SecureChannel.cs:line 830\n   at System.Net.Security.SecureChannel.NextMessage(ReadOnlySpan`1 incomingBuffer) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SecureChannel.cs:line 726\n   at System.Net.Security.SslStream.ProcessBlob(Int32 frameSize) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 375\n   at System.Net.Security.SslStream.ReceiveBlobAsync[TIOAdapter](TIOAdapter adapter) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 342\n   at System.Net.Security.SslStream.ForceAuthenticationAsync[TIOAdapter](TIOAdapter adapter, Boolean receiveFirst, Byte[] reAuthenticationData, Boolean isApm) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 268\n   at System.Net.Security.SslStream.ProcessAuthentication(Boolean isAsync, Boolean isApm, CancellationToken cancellationToken) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.Implementation.cs:line 208\n   at System.Net.Security.SslStream.AuthenticateAsServer(SslServerAuthenticationOptions sslServerAuthenticationOptions) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.cs:line 345\n   at System.Net.Security.SslStream.AuthenticateAsServer(X509Certificate serverCertificate, Boolean clientCertificateRequired, SslProtocols enabledSslProtocols, Boolean checkCertificateRevocation) in /_/src/libraries/System.Net.Security/src/System/Net/Security/SslStream.cs:line 337\n   at System.Net.Security.Tests.SyncSslStreamSystemDefaultTest.<>c__DisplayClass1_0.<AuthenticateServerAsync>b__0() in /_/src/libraries/System.Net.Security/tests/FunctionalTests/SslStreamSystemDefaultsTest.cs:line 164\n   at System.Threading.Tasks.Task.InnerInvoke() in /_/src/libraries/System.Private.CoreLib/src/System/Threading/Tasks/Task.cs:line 2364\n   at System.Threading.Tasks.Task.<>c.<.cctor>b__274_0(Object obj) in /_/src/libraries/System.Private.CoreLib/src/System/Threading/Tasks/Task.cs:line 2350\n   at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state) in /_/src/libraries/System.Private.CoreLib/src/System/Threading/ExecutionContext.cs:line 289\n--- End of stack trace from previous location ---\n   at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state) in /_/src/libraries/System.Private.CoreLib/src/System/Threading/ExecutionContext.cs:line 314\n   at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread) in /_/src/libraries/System.Private.CoreLib/src/System/Threading/Tasks/Task.cs:line 2314\n--- End of stack trace from previous location ---\n   at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks) in /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs:line 83\n   at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks) in /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs:line 111\n   at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks, Int32 millisecondsTimeout) in /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs:line 71\n   at System.Net.Security.Tests.SslStreamSystemDefaultTest.ClientAndServer_OneOrBothUseDefault_Ok(Nullable`1 clientProtocols, Nullable`1 serverProtocols) in /_/src/libraries/System.Net.Security/tests/FunctionalTests/SslStreamSystemDefaultsTest.cs:line 60\n--- End of stack trace from previous location ---",
                    "Reason": "",
                    "Duration": 3308,
                    "Output": null,
                    "FailureReason": null,
                    "Type": "System.Net.Security.Tests.SyncSslStreamSystemDefaultTest",
                    "Method": "ClientAndServer_OneOrBothUseDefault_Ok",
                    "Arguments": "clientProtocols: Ssl2 | Default | Tls11 | Tls12, serverProtocols: Default"
                }
            ]
        },
        "external": null
    },
    "OtherEvents": null,
    "Job": "8f4028f3-d56e-41c0-a6ac-75d47b6822a4",
    "Name": "System.Net.Security.Tests",
    "State": "Passed"
}

Closing and focus on the #34337

@karelz
Copy link
Member

karelz commented May 12, 2020

Duplicate of #34337

@karelz karelz marked this as a duplicate of #34337 May 12, 2020
@aik-jahoda aik-jahoda marked this as not a duplicate of #34337 May 22, 2020
@aik-jahoda
Copy link
Contributor

I'm able to reproduce similar null reference exception and I expect it is from the same root cause thus reopening.

@aik-jahoda aik-jahoda reopened this May 22, 2020
@karelz karelz modified the milestones: 5.0, Future Jun 5, 2020
@aik-jahoda aik-jahoda mentioned this issue Jun 5, 2020
Merged
@wfurt wfurt mentioned this issue Aug 31, 2020
Closed
@Anipik Anipik added the blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' label Sep 2, 2020
@jashook jashook mentioned this issue Sep 2, 2020
Closed
@directhex directhex mentioned this issue Sep 30, 2020
Closed
@directhex
Copy link
Contributor

Definitely still a problem, e.g. https://helix.dot.net/api/2019-06-17/jobs/7ad9e59f-28f1-4e71-8f8c-69ddbc03698d/workitems/System.Net.Security.Tests/files/console.0b2bbc5d.log was within the last 2 weeks

@aik-jahoda
Copy link
Contributor

Closed by #36875, please reopen in case of next occurence

@karelz karelz modified the milestones: Future, 6.0.0 Jan 26, 2021
@Anipik Anipik reopened this Feb 8, 2021
@Anipik
Copy link
Contributor

Anipik commented Feb 8, 2021

Failed here https://dev.azure.com/dnceng/public/_build/results?buildId=982443&view=results

log https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-heads-master-d220956cb6aa4d46ab/System.Net.Security.Tests/console.d5707fc8.log?sv=2019-07-07&se=2021-02-27T17%3A34%3A03Z&sr=c&sp=rl&sig=6Ku0E7%2Bp7kYVfpVL71sgrbJhO0XT9SDCuydUcFeKTQ4%3D

@karelz
Copy link
Member

karelz commented May 12, 2021

No hits of NullReference anymore -- remaining ObjectDisposedException failures tracked in #30724.

@karelz karelz closed this as completed May 12, 2021
@ghost ghost locked as resolved and limited conversation to collaborators Jun 11, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@aik-jahoda aik-jahoda

Labels
area-System.Net.Security blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' bug os-windows tenet-reliability Reliability/stability related issue (stress, load problems, etc.) test-run-core Test failures in .NET Core test runs
Projects
None yet
Milestone
6.0.0
Development

No branches or pull requests
7 participants
@directhex @aik-jahoda @karelz @ViktorHofer @Anipik @wfurt @Dotnet-GitSync-Bot