geom-error in generate_wind_farms

[KathiEsterl]

I ran into this error several times and do not know what it is related to:

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
super(GeoDataFrame, self).__setitem__(key, value)
[2021-07-27 15:48:15,224] {taskinstance.py:1150} ERROR - 'NoneType' object has no attribute '_geom'
Traceback (most recent call last):
  File "/home/kathiesterl/vegon_data/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 984, in _run_raw_task
    result = task_copy.execute(context=context)
  File "/home/kathiesterl/vegon_data/lib/python3.7/site-packages/airflow/operators/python_operator.py", line 113, in execute
    return_value = self.execute_callable()
  File "/home/kathiesterl/vegon_data/lib/python3.7/site-packages/airflow/operators/python_operator.py", line 118, in execute_callable
    return self.python_callable(*self.op_args, **self.op_kwargs)
  File "/home/kathiesterl/Git/eGon-data/src/egon/data/processing/wind_farms.py", line 85, in wind_power_parks
    fed_state,
  File "/home/kathiesterl/Git/eGon-data/src/egon/data/processing/wind_farms.py", line 433, in wind_power_states
    "egon_power_plants", schema="supply", con=db.engine(), if_exists="append"
  File "/home/kathiesterl/vegon_data/lib/python3.7/site-packages/geopandas/geodataframe.py", line 1684, in to_postgis
    self, name, con, schema, if_exists, index, index_label, chunksize, dtype
  File "/home/kathiesterl/vegon_data/lib/python3.7/site-packages/geopandas/io/sql.py", line 402, in _write_postgis
    gdf = _convert_to_ewkb(gdf, geom_name, srid)
  File "/home/kathiesterl/vegon_data/lib/python3.7/site-packages/geopandas/io/sql.py", line 286, in _convert_to_ewkb
    geoms = [dumps(geom, srid=srid, hex=True) for geom in gdf[geom_name]]
  File "/home/kathiesterl/vegon_data/lib/python3.7/site-packages/geopandas/io/sql.py", line 286, in <listcomp>
    geoms = [dumps(geom, srid=srid, hex=True) for geom in gdf[geom_name]]
  File "/home/kathiesterl/vegon_data/lib/python3.7/site-packages/shapely/wkb.py", line 42, in dumps
    geom = lgeos.GEOSGeom_clone(ob._geom)
AttributeError: 'NoneType' object has no attribute '_geom'
[2021-07-27 15:48:15,235] {taskinstance.py:1194} INFO - Marking task as FAILED. dag_id=egon-data-processing-pipeline, task_id=generate_wind_farms, execution_date=20210727T115541, start_date=20210727T134721, end_date=20210727T134815
[2021-07-27 15:48:17,043] {local_task_job.py:102} INFO - Task exited with return code 1

[ClaraBuettner]

I can not reproduce this error. Do you still have the complete log of this task? I'm wondering if another error or warning occurred earlier.

[KathiEsterl]

I can not reproduce this error. Do you still have the complete log of this task? I'm wondering if another error or warning occurred earlier.

I sent you the complete log via mail and will try and see if this error still occurs.

[KathiEsterl]

I can not reproduce this error. Do you still have the complete log of this task? I'm wondering if another error or warning occurred earlier.

I sent you the complete log via mail and will try and see if this error still occurs.

Now that I have found the part to upload files:

error_wind.log

[ClaraBuettner]

The problem also occurred on the server. It is caused by the partial migration to the datasets - when the mv_grid_district creation is skipped due to versioning but the subst_id changed in osmTGmod. Then some subst_ids from the mv_grid_districts don't match to the etrago buses.
This also explains why the issue only occurred sometimes. The problem is fixed automatically when osmTGmod is migrated to the datasets because a new run of osmTGmod then triggers a new definition of the mv grid districts.

[ClaraBuettner]

The migration of osmTGmod to datasets was merged into dev. When this error still occurs, please make sure to re-run the MV grid district creation.