Code

New processor API#1240

Code

Merged

kba merged 245 commits intoOCR-D:masterOCR-D/core:masterfrom bertsky:new-processor-apibertsky/core:new-processor-apiCopy head branch name to clipboardJan 9, 2025

+3,080-1,323

Commits

Commits on Jun 10, 2024

• deprecate Processor.process()

  bertsky

  committed
  833dac7

  Copy full SHA for 833dac7

Commits on Jun 24, 2024

• fix OCR-D#274: no default -I / -O

  bertsky

  committed
  3f4c7f9

  Copy full SHA for 3f4c7f9

• workspace.download: fix typo in exception

  bertsky

  committed
  d2b5df3

  Copy full SHA for d2b5df3

• Processor: factor-out show_resource(), delegate to resolve_resource()

  bertsky

  committed
  9827c4d

  Copy full SHA for 9827c4d

• Processor: add setup(), run once in get_processor()

  bertsky

  committed
  38fd4aa

  Copy full SHA for 38fd4aa

• ocrd_cli_wrap_processor: fix workspace arg (not a kwarg)

  bertsky

  committed
  580988a

  Copy full SHA for 580988a

• Processor: refactor processing API…

  Show description for 224dfc5
  bertsky

  committed
  224dfc5

  Copy full SHA for 224dfc5

• DummyProcessor: re-implement via new process_page_*

  Show description for 9714aab
  bertsky

  committed
  9714aab

  Copy full SHA for 9714aab

• run_processor: adapt to process→process_workspace

  bertsky

  committed
  e5d4736

  Copy full SHA for e5d4736

• test DummyProcessor: adapt to new download default by setting download_files=False in tests (because they are not actually in the filesystem)

  bertsky

  committed
  809a01b

  Copy full SHA for 809a01b

• test DummyProcessor: override process_workspace() by delegating to process() directly

  bertsky

  committed
  dfe7f8e

  Copy full SHA for dfe7f8e

• test builtin ocrd-dummy: adapt to consistent filename

  bertsky

  committed
  1550668

  Copy full SHA for 1550668

• test processor: adapt to input_file_grp required

  bertsky

  committed
  75809b1

  Copy full SHA for 75809b1

• test processor: adapt to self.workspace only during run_processor

  bertsky

  committed
  c429da5

  Copy full SHA for c429da5

Commits on Jun 26, 2024

• Workspace.save_image_file: add kwarg file_path for predetermined local_filename

  bertsky

  committed
  295cdb6

  Copy full SHA for 295cdb6

• Processor.process_page_pcgts: add kwargs and allow returning derived images

  bertsky

  committed
  e2cbcb9

  Copy full SHA for e2cbcb9

• Workspace.save_image_file: save DPI metadata, too

  bertsky

  committed
  20a6a1c

  Copy full SHA for 20a6a1c

• Workspace.image_from_*: annotate 'DPI' in result dict and ensure it's used in meta-data of resulting image

  bertsky

  committed
  679ad85

  Copy full SHA for 679ad85

• test_workspace: adapt to image_from_* DPI and add assertions

  bertsky

  committed
  565a3d9

  Copy full SHA for 565a3d9

Commits on Jul 6, 2024

• autoload ocrd-tool.json and version from dist, executable name from entry point in stack

  bertsky

  committed
  46f81aa

  Copy full SHA for 46f81aa

• adapt to new Processor init (override metadata/version/executable name)

  bertsky

  committed
  4dd83aa

  Copy full SHA for 4dd83aa

• tests: adapt to new Processor init (override metadata/version/executable name)

  bertsky

  committed
  4cafbcc

  Copy full SHA for 4cafbcc

Commits on Jul 29, 2024

• generate_processor_help: include process_workspace docstring, too

  bertsky

  committed
  9c9a4c9

  Copy full SHA for 9c9a4c9

Commits on Aug 8, 2024

• get_processor: also run setup if instance_caching

  bertsky

  authored
  aa0bd68

  Copy full SHA for aa0bd68

Commits on Aug 12, 2024

• ocrd-tool CLI: pass class in context

  bertsky

  committed
  99d1628

  Copy full SHA for 99d1628

• use more specific exception if parameters are invalid

  Show description for 12231b8
  

  bertsky

  and

  kba

  authored
  12231b8

  Copy full SHA for 12231b8

• run_processor w/ mem_usage: pass as args tuple

  Show description for d112f8f
  

  bertsky

  and

  kba

  authored
  d112f8f

  Copy full SHA for d112f8f

• Processor.process_workspace: add fileGrp assertions

  bertsky

  committed
  319ceaa

  Copy full SHA for 319ceaa

• process_page_pcgts: add (variadic) type checks

  Show description for 80590a9
  

  bertsky

  and

  kba

  authored
  80590a9

  Copy full SHA for 80590a9

• run_processor: fix typo

  bertsky

  committed
  68ae8ff

  Copy full SHA for 68ae8ff

• Processor init: deprecate passing workspace

  bertsky

  committed
  2a18883

  Copy full SHA for 2a18883

• docs: fix relative VERSION path

  bertsky

  committed
  b9338b4

  Copy full SHA for b9338b4

• docs: do/not exclude tests/src

  bertsky

  committed
  6ca6a40

  Copy full SHA for 6ca6a40

• docs: add ocrd_network module

  bertsky

  committed
  bc9ec05

  Copy full SHA for bc9ec05

• docs:regenerated rST

  bertsky

  committed
  54f1d88

  Copy full SHA for 54f1d88

Commits on Aug 13, 2024

• test_mets_server: fix arg vs kwarg

  bertsky

  committed
  67633f5

  Copy full SHA for 67633f5

• mets_server: ClientSideOcrdMets needs OcrdMets-like kwargs (without deprecation)

  bertsky

  committed
  751a1fe

  Copy full SHA for 751a1fe

• Processor/CLI decorator: 🔥 separate kwargs and constructor…

  Show description for 86d9569
  bertsky

  committed
  86d9569

  Copy full SHA for 86d9569

• Processor / ocrd-tool.json: 🔥 fileGrp cardinality checks…

  Show description for 1f6f0c8
  bertsky

  committed
  1f6f0c8

  Copy full SHA for 1f6f0c8

• test_processor: adapt to Processor init changes

  bertsky

  committed
  9b417d6

  Copy full SHA for 9b417d6

• adapt to ocrd-tool.json cardinality changes

  bertsky

  committed
  fbe83c9

  Copy full SHA for fbe83c9

• use up-to-date kwargs (avoiding old deprecations)

  bertsky

  committed
  09dd54b

  Copy full SHA for 09dd54b

• hide/test expected deprecation warnings

  bertsky

  committed
  af880e4

  Copy full SHA for af880e4

• improve output in case of assertion failures

  bertsky

  committed
  e381a0f

  Copy full SHA for e381a0f

Commits on Aug 14, 2024

• Set VERSION to upcoming 3.0.0a1

  kba

  committed
  874b506

  Copy full SHA for 874b506

• CircleCI: use version 2.1

  bertsky

  authored
  5ffe3cb

  Copy full SHA for 5ffe3cb

• Merge branch 'master' into new-processor-api

  kba

  authored
  dd3046e

  Copy full SHA for dd3046e

• test_bashlib: use version verbatim

  bertsky

  committed
  93a742e

  Copy full SHA for 93a742e

• .

  kba

  committed
  5117684

  Copy full SHA for 5117684

• fix make spec

  kba

  committed
  456cc6d

  Copy full SHA for 456cc6d

• Merge branch 'new-processor-api' of https://github.com/bertsky/core into new-processor-api

  kba

  committed
  e03a906

  Copy full SHA for e03a906

• adapt lib.bash to handle prerelease suffixes like a1, b2, rc3

  kba

  committed
  7a9fc27

  Copy full SHA for 7a9fc27

• process_page_pcgts must return OcrdProcessResult

  kba

  committed
  90afb8a

  Copy full SHA for 90afb8a

Commits on Aug 15, 2024

• bashlib ocrd__minversion: compare prerelease suffix alphabetically

  Show description for 70ad191
  

  kba

  and

  bertsky

  authored
  70ad191

  Copy full SHA for 70ad191

• Merge pull request #7 from OCR-D/bashlib-version-yak-shaving

  Show description for 678158a
  bertsky

  authored
  678158a

  Copy full SHA for 678158a

• fix ocrd_tool.schema.yml cardinality oneOf syntax, update spec

  bertsky

  committed
  228272b

  Copy full SHA for 228272b

• bashlib: fix ocrd__minversion test syntax

  bertsky

  committed
  5aba83b

  Copy full SHA for 5aba83b

• reimplement OcrdPageResult

  kba

  committed
  3d094d6

  Copy full SHA for 3d094d6

• update spec (with new ocrd_tool.schema)

  bertsky

  committed
  f8b6896

  Copy full SHA for f8b6896

• update spec to v3.25.0, ocrd_tool.schema.yml

  kba

  committed
  72eb75b

  Copy full SHA for 72eb75b

• process_page_file: fix handling of images

  kba

  committed
  75cb20c

  Copy full SHA for 75cb20c

• process_page_pcgts: remove output_file_id, replace OcrdPageResult.file_id with OcrdPageResult.file_id_suffix

  kba

  committed
  9a1c7ad

  Copy full SHA for 9a1c7ad

• OcrdPageResultImage requires passing alternative_image w/o filename set

  kba

  committed
  60ad424

  Copy full SHA for 60ad424

• Processor.verify: handle -1 case

  Show description for 50dfdd6
  

  kba

  and

  bertsky

  authored
  50dfdd6

  Copy full SHA for 50dfdd6

• processor.base: remove obsolete FIXME

  Show description for 53f2634
  

  kba

  and

  bertsky

  authored
  53f2634

  Copy full SHA for 53f2634

• Processor.process_page_pcgts: update docstring for file_path/alternative_image

  Show description for d210afa
  

  kba

  and

  bertsky

  authored
  d210afa

  Copy full SHA for d210afa

• export OcrdPageResult{Image} from ocrd.processor

  kba

  committed
  5718cf9

  Copy full SHA for 5718cf9

• Processor.process.page_pcgts: simplify references in docstring

  

  bertsky

  authored and

  kba

  committed
  f5f3145

  Copy full SHA for f5f3145

• Merge branch 'processor-result-object' of https://github.com/OCR-D/core into processor-result-object

  kba

  committed
  db68bb5

  Copy full SHA for db68bb5

• allow "from ocrd_models import OcrdPage

  kba

  committed
  7045318

  Copy full SHA for 7045318

• Merge branch 'processor-result-object' into new-processor-api

  kba

  committed
  a9dba73

  Copy full SHA for a9dba73

• 📝 v3.0.0a1

  kba

  committed
  3220e3f

  Copy full SHA for 3220e3f

Commits on Aug 16, 2024

• Update CHANGELOG.md

  Show description for e1f5744
  

  kba

  and

  bertsky

  authored
  e1f5744

  Copy full SHA for e1f5744

• ocrd: more convenience imports

  bertsky

  committed
  80d42f1

  Copy full SHA for 80d42f1

• ocrd.cli: more fix module import order, export help cmd

  bertsky

  committed
  0e57b4b

  Copy full SHA for 0e57b4b

• fix imports

  bertsky

  committed
  9cfd70c

  Copy full SHA for 9cfd70c

• fix type assertion

  bertsky

  committed
  95212b5

  Copy full SHA for 95212b5

• ocrd_utils: forgot to export scale_coordinates at toplvl

  bertsky

  committed
  4aa288a

  Copy full SHA for 4aa288a

• fix 9cfd70c

  bertsky

  committed
  8044e60

  Copy full SHA for 8044e60

• fix 9cfd70c (revert to wrong import order to avoid circle)

  bertsky

  committed
  21ff810

  Copy full SHA for 21ff810

• s,PcGtsType,OcrdPage,

  kba

  committed
  4077e8d

  Copy full SHA for 4077e8d

Commits on Aug 19, 2024

• add config.OCRD_DOWNLOAD_INPUT

  kba

  committed
  cd4c96c

  Copy full SHA for cd4c96c

• define self.logger in processor base constructor

  kba

  committed
  3125255

  Copy full SHA for 3125255

• Merge branch 'master' into new-processor-api

  kba

  committed
  0adb9fb

  Copy full SHA for 0adb9fb

• OcrdPage proxy object for PcGtsType, including etree and mappings

  kba

  committed
  dcf7c52

  Copy full SHA for dcf7c52

• Processor.base: have a (hopefully) thread-safe logger for the base class

  kba

  committed
  cf45d8b

  Copy full SHA for cf45d8b

Commits on Aug 20, 2024

• Processor.zip_input_files: warning instead of exception for missing input files

  bertsky

  committed
  785d607

  Copy full SHA for 785d607

• Processor.zip_input_files: introduce NonUniqueInputFile exception

  bertsky

  committed
  b12849d

  Copy full SHA for b12849d

• Processor.process_workspace: zip_input_files w/o require_first

  bertsky

  committed
  95d3658

  Copy full SHA for 95d3658

• Merge remote-tracking branch 'origin/download-files-config-var' into new-processor-api-input-file-errors

  bertsky

  committed
  2e2bda6

  Copy full SHA for 2e2bda6

• Processor.zip_input_files: introduce MissingInputFile exception and config.OCRD_MISSING_INPUT

  bertsky

  committed
  c729841

  Copy full SHA for c729841

• OcrdPage: clearer docstring

  Show description for 7df81af
  

  kba

  and

  bertsky

  authored
  7df81af

  Copy full SHA for 7df81af

• jsonschema: switch from draft6 to draft2019-09

  kba

  committed
  0ab6942

  Copy full SHA for 0ab6942

• require jsonschema>4 for draft 2019-09

  kba

  committed
  66c50b3

  Copy full SHA for 66c50b3

• OcrdToolValidator: set defaults, handle deprecated

  kba

  committed
  94e2e60

  Copy full SHA for 94e2e60

• processor.base: validate/setdefault ocrd-tool.json on first access

  kba

  committed
  2e7bdc2

  Copy full SHA for 2e7bdc2

• update spec and ocrd_tool.schema.yml

  kba

  committed
  346f166

  Copy full SHA for 346f166

• processor parameter decorator: no '{}' default (unnecessary)

  bertsky

  committed
  577baa5

  Copy full SHA for 577baa5

• Processor: add error handling…

  Show description for f00ecda
  bertsky

  committed
  f00ecda

  Copy full SHA for f00ecda

Commits on Aug 21, 2024

• ocrd_utils.config: add variables to module docstring

  bertsky

  committed
  fdd5d16

  Copy full SHA for fdd5d16

• improve docstrings, re-generate docs

  bertsky

  committed
  6d87f9e

  Copy full SHA for 6d87f9e

• Processor.zip_input_files: more verbose log msg

  Show description for 9942bbe
  

  bertsky

  and

  kba

  authored
  9942bbe

  Copy full SHA for 9942bbe

• test_processor: test for specific exception

  Show description for 8a584e9
  

  bertsky

  and

  kba

  authored
  8a584e9

  Copy full SHA for 8a584e9

• test_processor: fix missing import

  bertsky

  committed
  8077d45

  Copy full SHA for 8077d45

• Merge pull request #12 from bertsky/new-processor-api-input-file-errors

  Show description for 6b68f7a
  bertsky

  authored
  6b68f7a

  Copy full SHA for 6b68f7a

• Merge branch 'new-processor-api' into processor-logger

  bertsky

  authored
  1b4cd3c

  Copy full SHA for 1b4cd3c

• Merge pull request #10 from OCR-D/processor-logger

  Show description for 7f3bfa2
  bertsky

  authored
  7f3bfa2

  Copy full SHA for 7f3bfa2

• Merge pull request #11 from OCR-D/ocrd-page-with-etree

  Show description for d4d40e3
  bertsky

  authored
  d4d40e3

  Copy full SHA for d4d40e3

• Merge pull request #13 from OCR-D/validate-ocrd-tool-runtime

  Show description for 111a52e
  bertsky

  authored
  111a52e

  Copy full SHA for 111a52e

• OcrdPage: fix typeing typo

  bertsky

  committed
  cf7b193

  Copy full SHA for cf7b193

• dummy_processor: fix typos from logging

  bertsky

  committed
  9af8670

  Copy full SHA for 9af8670

• tests report.is_valid: improve output on failure

  bertsky

  committed
  c6d9736

  Copy full SHA for c6d9736

• JsonValidator: fix deprecation warning (by actually checking instance)

  bertsky

  committed
  161cf0c

  Copy full SHA for 161cf0c

• predefine union types OcrdFileType and OcrdPageType

  bertsky

  committed
  b2e6485

  Copy full SHA for b2e6485

• processor CLI --debug: set all to ABORT (not just MISSING_OUTPUT)

  bertsky

  committed
  822d731

  Copy full SHA for 822d731

• 📝 changelog

  bertsky

  committed
  3a7a771

  Copy full SHA for 3a7a771

Commits on Aug 22, 2024

• 📦 v3.0.0a2

  kba

  committed
  2bdb6c4

  Copy full SHA for 2bdb6c4

• remove make *-workaround, we will not do that for v3+

  kba

  committed
  00bd6fe

  Copy full SHA for 00bd6fe

• Processor.parameter: only validate when set…

  Show description for d777527
  bertsky

  committed
  d777527

  Copy full SHA for d777527

• get_processor: ensure passing non-empty parameter, rely on _setup to call setup

  bertsky

  committed
  7998aae

  Copy full SHA for 7998aae

• test_processor: adapt, check required parameters

  bertsky

  committed
  cc8592b

  Copy full SHA for cc8592b

• improve _setup docstring

  Show description for 45e556d
  

  bertsky

  and

  kba

  authored
  45e556d

  Copy full SHA for 45e556d

• Processor._setup: raise with full ParameterValidator report

  Show description for d4c802b
  

  bertsky

  and

  kba

  authored
  d4c802b

  Copy full SHA for d4c802b

• get_processor: parameter only as kwarg

  Show description for b28fefb
  

  bertsky

  and

  kba

  authored
  b28fefb

  Copy full SHA for b28fefb

• tests: adapt for get_processor parameter only as kwarg

  bertsky

  committed
  642938b

  Copy full SHA for 642938b

• Processor.parameter: make the bound dict read-only

  Show description for f5e5c54
  

  bertsky

  and

  kba

  authored
  f5e5c54

  Copy full SHA for f5e5c54

• Processor.parameter: move ParameterValidator back to setter, convert to plain dict in getter for serialization etc

  bertsky

  committed
  f2d53a6

  Copy full SHA for f2d53a6

• Processor.parameter: frozendict instead of mappingproxy, add test

  bertsky

  committed
  7297ca2

  Copy full SHA for 7297ca2

• introduce Processor.shutdown to be overridden (called at deinit or parameter re-assignment)

  bertsky

  committed
  6cd4a34

  Copy full SHA for 6cd4a34

Commits on Aug 23, 2024

• Processor: introduce max_instances class attribute

  bertsky

  committed
  407bff8

  Copy full SHA for 407bff8

• get_cached_processor: set lru_cache maxsize from min(cfg,class) at runtime

  bertsky

  committed
  c9fbb2c

  Copy full SHA for c9fbb2c

• test get_processor instance_caching w/ max_instances

  bertsky

  committed
  9c212a9

  Copy full SHA for 9c212a9

• test get_processor instance_caching w/ clear_cache

  bertsky

  committed
  a413f04

  Copy full SHA for a413f04

Commits on Aug 24, 2024

• 📦 v3.0.0a2

  

  kba

  authored and

  bertsky

  committed
  870523c

  Copy full SHA for 870523c

• remove make *-workaround, we will not do that for v3+

  

  kba

  authored and

  bertsky

  committed
  20bb6d1

  Copy full SHA for 20bb6d1

• Processor.metadata_location property to specify where in the package ocrd-tool.json is found

  

  kba

  authored and

  bertsky

  committed
  faa59a8

  Copy full SHA for faa59a8

• Processor.verify: always check cardinality (as we now have the defaults from ocrd-tool.json)

  bertsky

  committed
  5819c81

  Copy full SHA for 5819c81

• fix --log-filename (6fc6060): apply in ocrd_cli_wrap_processor

  bertsky

  committed
  4f88f1d

  Copy full SHA for 4f88f1d

• fix exception

  bertsky

  committed
  d621f36

  Copy full SHA for d621f36

• adapt to PIL.Image moved constants

  bertsky

  committed
  4868fb1

  Copy full SHA for 4868fb1

• ocrd_utils: add parse_json_file_with_comments

  bertsky

  committed
  da72c0a

  Copy full SHA for da72c0a

• cli.workspace: pass fileGrp as well, improve description

  bertsky

  committed
  ca78b94

  Copy full SHA for ca78b94

• OcrdMets.add_agent: does not have positional args

  bertsky

  committed
  cf41745

  Copy full SHA for cf41745

• remove misplaced kwargs from run_processor

  bertsky

  committed
  cadc6e6

  Copy full SHA for cadc6e6

• Processor.metadata: refactor…

  Show description for 7966057
  bertsky

  committed
  7966057

  Copy full SHA for 7966057

• bashlib input-files: adapt, allow passing ocrd-tool.json path and executable name

  bertsky

  committed
  bba142d

  Copy full SHA for bba142d

• add to pylint karma

  bertsky

  committed
  32cdc5a

  Copy full SHA for 32cdc5a

• update pylintrc

  bertsky

  committed
  a95f269

  Copy full SHA for a95f269

• processor.metadata_location: use self.__module__ not __package__

  kba

  committed
  50c088e

  Copy full SHA for 50c088e

• Merge pull request #17 from OCR-D/new-processor-api-parameter-setup

  Show description for ad8c76e
  bertsky

  authored
  ad8c76e

  Copy full SHA for ad8c76e

Commits on Aug 25, 2024

• pylint: try ignoring generateds (again)

  bertsky

  committed
  8211237

  Copy full SHA for 8211237

• Merge pull request #14 from bertsky/new-processor-api-parameter-setup

  Show description for b53724e
  bertsky

  authored
  b53724e

  Copy full SHA for b53724e

• 📝 update changelog

  bertsky

  committed
  3e2700c

  Copy full SHA for 3e2700c

• test_bashlib: allow testing prereleases successfully

  bertsky

  committed
  342df58

  Copy full SHA for 342df58

• Processor.process_page_file / OcrdPageResultImage: allow PageType instead of AlternativeImageType

  bertsky

  committed
  11ed8c5

  Copy full SHA for 11ed8c5

Commits on Aug 26, 2024

• Merge branch 'master' into new-processor-api

  Show description for 69571fe
  kba

  committed
  69571fe

  Copy full SHA for 69571fe

• 📦 v3.0.0b1

  kba

  committed
  77e31f2

  Copy full SHA for 77e31f2

• 🔥 bad no good terrible hack to fix integration_test

  kba

  committed
  d3ee57c

  Copy full SHA for d3ee57c

Commits on Aug 27, 2024

• generate_processor_help: avoid repeating docstrings from superclass

  bertsky

  committed
  0245f4b

  Copy full SHA for 0245f4b

• Processor.process_workspace: abort anyway if too many failures (OCRD_MAX_MISSING_OUTPUTS)

  bertsky

  committed
  efe4201

  Copy full SHA for efe4201

• adapt tests for OCRD_MAX_MISSING_OUTPUTS

  bertsky

  committed
  fce7627

  Copy full SHA for fce7627

• Merge pull request #19 from OCR-D/new-processor-api-fix-editable

  Show description for a50d0bb
  bertsky

  authored
  a50d0bb

  Copy full SHA for a50d0bb

• Processor: add per-page timeouts and parallelism…

  Show description for c08166e
  bertsky

  committed
  c08166e

  Copy full SHA for c08166e

• add tests for processor per-page timeout and parallelism

  bertsky

  committed
  c3a8380

  Copy full SHA for c3a8380

• 📝 update changelog

  bertsky

  committed
  b1b7a49

  Copy full SHA for b1b7a49

Commits on Aug 28, 2024

• ClientSideOcrdMets: use same logger name prefix as server

  bertsky

  committed
  9b80ae1

  Copy full SHA for 9b80ae1

• Processor: fix ignore (negative/zero) cases for max_workers / max_page_seconds

  bertsky

  committed
  be6b59d

  Copy full SHA for be6b59d

• test_mets_server: use tmpdir to avoid side effects between suites

  bertsky

  committed
  0b5286f

  Copy full SHA for 0b5286f

• test processor timeout/parallel: avoid side effects to dummy tool json

  bertsky

  committed
  61e1042

  Copy full SHA for 61e1042

• tess: adapt to wording of exceptions

  bertsky

  committed
  e395b56

  Copy full SHA for e395b56

• ClientSideOcrdMets: partial revert of 9b80ae1

  bertsky

  committed
  a59ba6a

  Copy full SHA for a59ba6a

• disableLogging: re-instate root logger, to

  bertsky

  committed
  554a67d

  Copy full SHA for 554a67d

• test-logging: also remove ocrd.log from tempdir

  bertsky

  committed
  1114cd9

  Copy full SHA for 1114cd9

• Processor: fix 7966057 (deprecated passing of ocrd_tool or version via init)

  bertsky

  committed
  ce6d239

  Copy full SHA for ce6d239

• Processor.generate_processor_help: forgot to include --log-filename

  bertsky

  committed
  df99160

  Copy full SHA for df99160

• bashlib: re-add --log-filename, implement as stderr redirect

  bertsky

  committed
  eb74fab

  Copy full SHA for eb74fab

• test_processor: add legacy (v2-style) dummy case

  bertsky

  committed
  8565a8f

  Copy full SHA for 8565a8f

• 📝 update changelog

  bertsky

  committed
  abe069a

  Copy full SHA for abe069a

• 📝 update readmes (esp. new config variables)

  bertsky

  committed
  11f9264

  Copy full SHA for 11f9264

Commits on Aug 30, 2024

• 📦 v3.0.0b2

  kba

  committed
  ca88122

  Copy full SHA for ca88122

• ocrd_utils.config: add reset_defaults()

  bertsky

  committed
  837aba7

  Copy full SHA for 837aba7

• add test for OcrdEnvConfig.reset_defaults()

  bertsky

  committed
  85e96ff

  Copy full SHA for 85e96ff

• Processor: improve processing log messages

  bertsky

  committed
  8911c3b

  Copy full SHA for 8911c3b

• ocrd.cli doc: don't rewrap description lists

  bertsky

  committed
  98d97fc

  Copy full SHA for 98d97fc

• 📦 v3.0.0b3

  kba

  committed
  cb758e8

  Copy full SHA for cb758e8

• Processor.metadata_location: find location package prefix (necessary for namespace packages)

  bertsky

  committed
  1ed38a6

  Copy full SHA for 1ed38a6

Commits on Sep 1, 2024

• Processor: log when max_workers / max_page_seconds are in effect

  bertsky

  committed
  7d98c27

  Copy full SHA for 7d98c27

• Workspace.reload_mets: fix for METS server case

  bertsky

  committed
  6b23b65

  Copy full SHA for 6b23b65

Commits on Sep 2, 2024

• 📝 changelog

  kba

  committed
  cac05cd

  Copy full SHA for cac05cd

• 📦 v3.0.0b4

  kba

  committed
  0b0d419

  Copy full SHA for 0b0d419

• OcrdMetsServer.add_file: pass on 'force' kwarg, too

  bertsky

  committed
  a34beb8

  Copy full SHA for a34beb8

• test_mets_server: add test for force (overwrite)

  bertsky

  committed
  dfa715d

  Copy full SHA for dfa715d

• test_processor: add test for force (overwrite) w/ METS Server

  bertsky

  committed
  9a8c41d

  Copy full SHA for 9a8c41d

Commits on Sep 3, 2024

• add typing, extend docs

  

  kba

  authored and

  bertsky

  committed
  65ab63c

  Copy full SHA for 65ab63c

Commits on Sep 5, 2024

• Processor.verify: revert 5819c81 (we still have no defaults in json loaded from v2)

  bertsky

  committed
  73a395e

  Copy full SHA for 73a395e

• Processor.process_page_file / OcrdPageResultImage: allow None instead of AlternativeImageType

  bertsky

  committed
  3382ad9

  Copy full SHA for 3382ad9

Commits on Sep 15, 2024

• PcGts.Page.id / make_xml_id: replace '/' with '_'

  bertsky

  committed
  cad4777

  Copy full SHA for cad4777

• ocrd.cli.ocrd-tool resolve-resource: fix (forgot to print result)

  bertsky

  committed
  10b2abc

  Copy full SHA for 10b2abc

• processor CLI: delegate --resolve-resource, too

  bertsky

  committed
  bd64444

  Copy full SHA for bd64444

• METS Server: also export+delegate physical_pages

  bertsky

  committed
  71e9841

  Copy full SHA for 71e9841

• ocrd.cli.workspace: consistently pass on --mets-server-url and --backup (also, simplify)

  bertsky

  committed
  01ccdf1

  Copy full SHA for 01ccdf1

• ocrd.cli.workspace server: add 'reload' and 'save'

  bertsky

  committed
  3301f9c

  Copy full SHA for 3301f9c

• ocrd.cli.bashlib input-files: pass on --mets-server-url, too

  bertsky

  committed
  dc2c758

  Copy full SHA for dc2c758

• ocrd.cli.validate tasks: pass on --mets-server-url, too

  bertsky

  committed
  42af6a3

  Copy full SHA for 42af6a3

• Processor.process_workspace(): do not show NotImplementedError context if fallback process() raises anything itself

  bertsky

  committed
  7ea8d57

  Copy full SHA for 7ea8d57

• Processor.verify: check output fileGrps as well (or OCRD_EXISTING_OUTPUT=OVERWRITE|SKIP or disjoint --page-id)

  bertsky

  committed
  9751256

  Copy full SHA for 9751256

• run_processor: be robust if ocrd_tool is missing steps

  bertsky

  committed
  f66753a

  Copy full SHA for f66753a

• lib.bash: fix errexit

  bertsky

  committed
  eb12a80

  Copy full SHA for eb12a80

• lib.bash input-files: pass on --mets-server-url, --overwrite, and parameters (necessary for required params)

  bertsky

  committed
  3355ea4

  Copy full SHA for 3355ea4

• lib.bash input-files: do not try to validate tasks here (impossible to get right with required parameters, and now covered by wrapped Processor.verify() already)

  bertsky

  committed
  f05f840

  Copy full SHA for f05f840

• Processor / Workspace.add_file: always force if config.OCRD_EXISTING_OUTPUT==OVERWRITE

  bertsky

  committed
  b5c1191

  Copy full SHA for b5c1191

• test processors: no need for 'force' kwarg anymore

  bertsky

  committed
  cbe465a

  Copy full SHA for cbe465a

• tests: make sure ocrd_utils.config gets reset whenever changing it globally

  bertsky

  committed
  3e214ca

  Copy full SHA for 3e214ca

• OcrdPage: add PageType.get_ReadingOrderGroups()

  bertsky

  committed
  c549c42

  Copy full SHA for c549c42

• update OcrdPage from generateds

  bertsky

  committed
  53b880f

  Copy full SHA for 53b880f

Commits on Sep 16, 2024

• 📦 v3.0.0b5

  kba

  committed
  687b06f

  Copy full SHA for 687b06f

• 📝 improve b5 changelog

  bertsky

  authored
  a43098e

  Copy full SHA for a43098e

• ocrd.cli.workspace: assert non-server in cmds mutating METS

  bertsky

  authored
  d2cb0fb

  Copy full SHA for d2cb0fb

Commits on Sep 27, 2024

• OcrdMets.get_physical_pages: cover return_divs w/o for_fileIds for_pageIds

  bertsky

  committed
  f678dca

  Copy full SHA for f678dca

• ocrd.cli.workspace: use physical_pages if possible, fix default output_field

  bertsky

  committed
  9064db0

  Copy full SHA for 9064db0

• Processor.process_page_file: avoid process_page_pcgts() if OCRD_EXISTING_OUTPUT!=OVERWRITE

  bertsky

  committed
  9530fcd

  Copy full SHA for 9530fcd

Commits on Oct 9, 2024

• ocrd_utils.initLogging: also add handler to root logger (to be consistent with file config and prevent imported libraries from initing logging first), but disable propagation for ocrd loggers (to a…

  Show description for 31a8474
  bertsky

  committed
  31a8474

  Copy full SHA for 31a8474

Commits on Oct 10, 2024

• CLI decorator: only import ocrd_network when needed

  bertsky

  committed
  d7049b1

  Copy full SHA for d7049b1

• Processor w/ OCRD_MAX_PARALLEL_PAGES: ThreadPoolExecutor→ProcessPoolExecutor

  bertsky

  committed
  a9d49c1

  Copy full SHA for a9d49c1

Commits on Oct 17, 2024

• Processor.process_workspace: apply timeout on process_page_file worker itself (rather than future query)

  bertsky

  committed
  588c91d

  Copy full SHA for 588c91d

• Processor w/ OCRD_MAX_PARALLEL_PAGES: concurrent.futures→loky

  bertsky

  committed
  d126bdc

  Copy full SHA for d126bdc

Commits on Oct 19, 2024

• Processor w/o OCRD_MAX_PARALLEL_PAGES: dummy instead of executor

  bertsky

  committed
  afa7f30

  Copy full SHA for afa7f30

• ocrd.process.profile logger: account for subprocess CPU time, too

  bertsky

  committed
  5821701

  Copy full SHA for 5821701

Commits on Oct 21, 2024

• Processor.process_workspace: improve reporting, raise early if too many failures already (rate will be too low)

  bertsky

  committed
  53b1854

  Copy full SHA for 53b1854

Commits on Oct 23, 2024

• Processor: refactor process_workspace into overridable subfuncs

  bertsky

  committed
  4d66e37

  Copy full SHA for 4d66e37

Commits on Oct 30, 2024

• Processor.process_workspace_handle_page_task: do not handler sigint

  bertsky

  committed
  71d6d49

  Copy full SHA for 71d6d49

• Processor.process_workspace_handle_tasks: log nr of ignored exceptions in the end

  bertsky

  committed
  d2d5290

  Copy full SHA for d2d5290

• Merge pull request #23 from bertsky/new-processor-api-process-worker

  Show description for 7932a6a
  bertsky

  authored
  7932a6a

  Copy full SHA for 7932a6a

• 📦 v3.0.0b6

  bertsky

  committed
  7d1503e

  Copy full SHA for 7d1503e

Commits on Nov 7, 2024

• tests: prevent side effects from ocrd_logging

  bertsky

  committed
  08a631c

  Copy full SHA for 08a631c

• initLogging: do not remove any previous handlers/levels

  bertsky

  committed
  f3e423a

  Copy full SHA for f3e423a

• initLogging: only add root handler instead of multiple redundant handlers with propagate=false

  bertsky

  committed
  3143518

  Copy full SHA for 3143518

• disableLogging: remove all handlers, reset all levels

  bertsky

  committed
  27323c6

  Copy full SHA for 27323c6

• setOverrideLogLevel: override all currently active loggers' level

  bertsky

  committed
  eb3120d

  Copy full SHA for eb3120d

• logging: increase default root (not ocrd) level from INFO to WARNING

  bertsky

  committed
  0186c53

  Copy full SHA for 0186c53

• Processor: update max_workers docstring

  bertsky

  committed
  5ba2720

  Copy full SHA for 5ba2720

Commits on Nov 11, 2024

• initLogging: call disableLogging if already initialized and force_reinit

  bertsky

  committed
  f8f71d8

  Copy full SHA for f8f71d8

• Processor: replace weakref with __del__ to trigger shutdown

  bertsky

  committed
  5f2f602

  Copy full SHA for 5f2f602

• Processor parallel pages: log via QueueHandler in subprocess, QueueListener in main

  bertsky

  committed
  0446b82

  Copy full SHA for 0446b82

Commits on Nov 12, 2024

• 📦 v3.0.0b7

  bertsky

  committed
  53c4c18

  Copy full SHA for 53c4c18