Feature/python sync actions

[AdamVyborny]

Jen aby procházelo CI je potřeba dát nějaký funkční config sem: https://github.com/keboola/generic-extractor/blob/5946efef1f6da2b10c732c01336b0aa316de394d/tests/phpunit/data/syncAction/config.json a pak tady upravit assert podle toho, co to má vracet:

generic-extractor/tests/phpunit/MockExecutionTest.php

Line 71 in 5946efe

self::assertStringContainsString('success

. Teď tam asi není správnej config, pro tu curl sync akci, co pouštím protože to padá na

logger.ERROR: Process failed to start. Error output: cURL command not provided [] []\n

A když tam dám třeba tu akci test_request, tak to zas vrací not implemented.

Každopádně, takhle by vám to zatím mohlo stačit pro nějaký laborování ne?

[davidesner]

Jo takhle je to super! Diky moc!

Jinak test_request jeste neni implementovana.

curl akce potrebuje curl command v parameters._curl_command

Jdu tam hodit aktualni verzi a zatim budeme testovat oproti tomuhle tagu

[davidesner]

@AdamVyborny jeste koukam, ze ten build trva fakt mega dlouho, asi kvuli tem dodatecnym instalacim, mozna by stalo za ten image dostat na dockerhub, nebo nejak cachovat jestli to jde

[AdamVyborny]

@davidesner něco zkusím: 013df8c

[AdamVyborny]

@davidesner to by asi mohlo fungovat. Ale je tam klíč v tý cache na commit s fallbackem na Dockerfile hash. Takže pokud přidáš něco do requirments.txt, tak se to asi neinvaliduje. To by se muselo nějak domazlit ještě.

[davidesner]

@AdamVyborny z nejakyho zahadnyho duvodu se spousti run akce misto te co volam. Netusis cim to muze byt?

response:

{
    "error": "[2024-05-09T12:33:57.413964+00:00] logger.WARNING: State file not found Configuration file '\/data\/in\/state.json' not found. [] []\n[2024-05-09T12:33:57.415158+00:00] logger.DEBUG: Using no authentication. [] []\n[2024-05-09T12:33:57.425675+00:00] logger.DEBUG: GET \/v2\/storage\/buckets?includes=Include___ HTTP\/1.1 X-StorageApi-Token: 9382-531255-DiVO2rkNCMqwe2fbWBIYHbI3ZyWadgJ3gGx12MgN User-Agent: GuzzleHttp\/7 Host: connection.keboola.com [] []\n[2024-05-09T12:33:57.594232+00:00] logger.ERROR: No value found for  in parent result. (level: 1) {\"parents\":[{\"stdClass\":{\"uri\":\"https:\/\/connection.keboola.com\/v2\/storage\/buckets\/in.c-bq_writer_test\",\"id\":\"in.c-bq_writer_test\",\"name\":\"c-bq_writer_test\",\"displayName\":\"bq_writer_test\",\"idBranch\":510379,\"stage\":\"in\",\"description\":\"\",\"tables\":\"https:\/\/connection.keboola.com\/v2\/storage\/buckets\/in.c-bq_writer_test\",\"created\":\"2024-03-04T11:50:25+0100\",\"lastChangeDate\":\"2024-03-04T11:52:24+0100\",\"isReadOnly\":false,\"dataSizeBytes\":3072,\"rowsCount\":10,\"isMaintenance\":false,\"backend\":\"snowflake\",\"sharing\":null,\"hasExternalSchema\":false,\"databaseName\":\"\",\"attributes\":[]}}]} []\n",
    "code": 0,
    "exceptionId": "exception-1164a7aee06ba68da9738470405dbda4",
    "status": "error",
    "context": []
}

[AdamVyborny]

@davidesner ta akce musí být v configu:

{
  "parameters": {
    ...
  },
  "action": "load_from_curl",
  "image_parameters": {
    ...
  }
}

[davidesner]

@davidesner ta akce musí být v configu:

{
  "parameters": {
    ...
  },
  "action": "load_from_curl",
  "image_parameters": {
    ...
  }
}

@AdamVyborny tak pry to takhle ma byt https://app.swaggerhub.com/apis/odinuv/sync-actions/1.1.2#/default
a je to tak u vsech komponent

[kudj]

great! the next step can be to add more examples/tests calls to the mock server, like in the original component