Code

Feature/enhancedlogging#156

Code

Merged

grantkriegerai merged 25 commits intodevInsight-Services-APAC/APAC-Capability-DAI-DbtFabricSparkNb:devfrom feature/enhancedloggingInsight-Services-APAC/APAC-Capability-DAI-DbtFabricSparkNb:feature/enhancedloggingCopy head branch name to clipboardAug 15, 2024

+138-75

Commits

Commits on Aug 7, 2024

• Made the changes to apply a different lakehouse for logging if selected as an option in the wrapper #50

  cheinamann

  committed
  fbcc82f

  Copy full SHA for fbcc82f

• Updated the Logs to include the master notebook being used for the execution and included this in the batch and log queries. #50

  cheinamann

  committed
  050ac0a

  Copy full SHA for 050ac0a

Commits on Aug 8, 2024

• Updated the notebooks to make the timestamps human readable formatted. Timestamps are in UTC. #50

  cheinamann

  committed
  0e7b01a

  Copy full SHA for 0e7b01a

• Fixing error where default is not being populated for log lakehouse

  cheinamann

  committed
  4785d09

  Copy full SHA for 4785d09

• Updated code to fix the child notebook log lakehouse

  cheinamann

  committed
  85db4b5

  Copy full SHA for 85db4b5

• Changed the log lakehouse from an option in the wrapper to a config in the profile.yml #50

  cheinamann

  committed
  3a3323f

  Copy full SHA for 3a3323f

• Added a fix for the child notebooks. #50

  cheinamann

  committed
  7754743

  Copy full SHA for 7754743

• Fixed a log lakehouse reference. #50

  cheinamann

  committed
  fe0959b

  Copy full SHA for fe0959b

• Fixed a log error #50

  cheinamann

  committed
  3a30b35

  Copy full SHA for 3a30b35

• Fixed batch logging error #50

  cheinamann

  committed
  bafd247

  Copy full SHA for bafd247

• Added code that will not fail the log lakehouse default if the profile value is not set #50

  cheinamann

  committed
  1bbcf98

  Copy full SHA for 1bbcf98

• Added config for log_lakehouse in profile setup #50

  cheinamann

  committed
  b7b6784

  Copy full SHA for b7b6784

• Added the log_lakehouse to the template. #50

  cheinamann

  committed
  fc94b89

  Copy full SHA for fc94b89

Commits on Aug 9, 2024

• Added a check for log_lakehouse in profile create #50

  cheinamann

  committed
  7f92d44

  Copy full SHA for 7f92d44

• Removed the parameter for child notebooks for the log lakehouse. #50

  cheinamann

  committed
  22dcccf

  Copy full SHA for 22dcccf

• Fixed a notebook reference #50

  cheinamann

  committed
  d3d7a6a

  Copy full SHA for d3d7a6a

• Fixed code error #50

  cheinamann

  committed
  c52b1c7

  Copy full SHA for c52b1c7

• Merge dev to feature

  cheinamann

  committed
  8a49555

  Copy full SHA for 8a49555

• Fixed a code error #50

  cheinamann

  committed
  43d157d

  Copy full SHA for 43d157d

Commits on Aug 11, 2024

• Merge remote-tracking branch 'origin/dev' into feature/enhancedlogging

  cheinamann

  committed
  3e88991

  Copy full SHA for 3e88991

Commits on Aug 12, 2024

• Changed creditial to optional for log lakehouse #50

  cheinamann

  committed
  2c2a15b

  Copy full SHA for 2c2a15b

Commits on Aug 13, 2024

• Updated docs #50

  cheinamann

  committed
  b82c689

  Copy full SHA for b82c689

• Removed the timestamp change as this breaks the log table for existing infra. A view can be created in it's place. #50

  cheinamann

  committed
  a615d17

  Copy full SHA for a615d17

• Fixed data type error #50

  cheinamann

  committed
  54d57e8

  Copy full SHA for 54d57e8

• Added a check to update the log tables if the columns dont exist. #50

  cheinamann

  committed
  871ab91

  Copy full SHA for 871ab91