Local parquet file $ ls -l /home/oracle/bigdata/sales_extended.parquet However, we can easily test accessing a local parquet file by creating an Oracle Directory and and then creating an External Table with TYPE ORACLE_BIGDATA. Unfortunately, I don’t have access to an Oracle BDA (Big Data Appliance) and the Oracle Big Data Lite Virtual Machine does not currently support the ORACLE_BIGDATA TYPE, so in this Blog I will be using my on-premise 19c database. Income_level = L: 300,000 and above Oracle Database 19.3 Total Size: 9262640 bytes parquet-tools head rekins$ parquet-tools head -n 2 sales_extended.parquet
Total RowCount: 916039 parquet-tools size rekins$ parquet-tools size sales_extended.parquet } parquet-tools rowcount rekins$ parquet-tools rowcount sales_extended.parquet Optional fixed_len_byte_array(5) amount_sold (DECIMAL(10,2)) Where is the parquet file to get size & human readable size to stdout parquet-tools schema rekins$ parquet-tools schema sales_extended.parquet d,-detailed Detailed size of each matching file Where is the parquet file to count rows to stdout d,-detailed Detailed rowcount of each matching file Prints the count of rows in Parquet file(s) Where is the source parquet files/directory to be merged Resulting file will still contain small row groups, which usually leads to bad n,-disable-crop Do not crop the output based on console width m,-disable-meta Do not dump row group and page metadata c,-column Dump only the given column, can be specified more than Prints the content and metadata of a Parquet file Where is the parquet file containing the schema to show d,-detailed Show detailed information about the schema. n,-records The number of records to show (default: 5) Prints the first n record of the Parquet file Where is the parquet file to print to stdout no-color Disable color output even if supported On my Mac I have installed both parquet-tools and avro-tools using Brew thus: brew install parquet-toolsīrew install avro-tools parquet-tools help rekins$ parquet-tools -h The parquet file format is binary and therefore not human readable, fortunately we can use parquet-tools to inspect the data and schema information. In my Getting started with Oracle BigData Blog I shared how you can obtain an example parquet file and set-up a FlashBlade s3 bucket, if you want to follow this Blog and don’t have access to a parquet file you can visit my previous Blog to get started.
0 kommentar(er)
