ARROW-12007: [C++] Loading parquet file returns "Invalid UTF8 payload…

…" error Judging from the comment "avoid spending time validating UTF8 data" with the setting of the false value to the cast_options.allow_invalid_utf8, it seems to me this was intended to be true rather than false. Also, this resolved the error I was getting through the arrow R package, which seems to be ARROW-12007. Closes apache#10759 from hideaki/cancel_unnecessary_utf8_check Authored-by: Hideaki Hayashi <[email protected]> Signed-off-by: Antoine Pitrou <[email protected]>
wesm · Jan 14, 2022 · a37836e · a37836e
1 parent 2fda73e
commit a37836e
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/cpp/src/parquet/arrow/reader_internal.cc b/cpp/src/parquet/arrow/reader_internal.cc
@@ -429,7 +429,7 @@ Status TransferBinary(RecordReader* reader, MemoryPool* pool,
   }
   ::arrow::compute::ExecContext ctx(pool);
   ::arrow::compute::CastOptions cast_options;
-  cast_options.allow_invalid_utf8 = false;  // avoid spending time validating UTF8 data
+  cast_options.allow_invalid_utf8 = true;  // avoid spending time validating UTF8 data
 
   auto binary_reader = dynamic_cast<BinaryRecordReader*>(reader);
   DCHECK(binary_reader);