Skip to content

[Bug] Docs contradict the code: file format types, Flink procedures, CDC actions #9972

Description

@thswlsqls

Search before asking

  • I searched in the issues and found nothing similar.

Paimon version
master 1d368b4 (2.2-SNAPSHOT)

Compute Engine
Flink, Spark, core

Minimal reproduce step

  • concepts/spec/fileformat.md: Lance and JSON tables list MULTISET, but LanceFileFormat and JsonFileFormat.validateDataType reject it; Lance and VortexFileFormat also reject VARIANT and inline BLOB, unlisted.
  • temporal_functions.html: now() documented as TIMESTAMP_LTZ(3); Expression.NowExpression.outputType() returns TIMESTAMP(3).
  • global-index/btree.mdx: btree-index.high-priority-pool-ratio and btree-index.compression-level (BTreeIndexOptions, read by BTreeGlobalIndexer) undocumented.
  • kafka_sync_database.html, pulsar_sync_database.html: list --ignore_incompatible, but only MySqlSyncDatabaseActionFactory parses it.
  • flink/procedures/compaction.md: CompactProcedure argument buckets undocumented.
  • mysql-cdc.mdx, mysql_sync_database.html: --table_conf_by_table (MySqlSyncDatabaseActionFactory.printHelp) missing.
  • flink/sql-query.mdx: split.target-size does not exist; CoreOptions defines source.split.target-size.
  • spark/sql-write.md: WHEN NOT MATCHED BY SOURCE (PaimonMergeIntoResolver) missing from MERGE INTO syntax.
  • flink/procedures/snapshots.md: order_than should be older_than (ExpireSnapshotsProcedure, ExpireChangelogsProcedure); expire_changelogs named-argument block is broken.
  • flink/procedures/repair.md: `dry_run` = true is not a named argument; the remove_unexisting_manifests syntax block calls remove_unexisting_files.

What doesn't meet your expectations?
Following the docs fails at CREATE TABLE (unsupported types), at CDC job start (a now() column pre-created as TIMESTAMP_LTZ(3) fails the schema compatibility check) or with a Flink ValidationException (procedure examples).

Anything else?
N/A

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions