Greenplum Database v5.29 Documentation
首页 白天 夜间 BookChat 小程序 小程序 下载 阅读记录
  • 书签 我的书签
  • 添加书签 添加书签 移除书签 移除书签

Using the Greenplum-Spark Connector

来源 Greenplum 浏览 2 扫码 打印 2026-10-31 00:58:18
  • Using the Greenplum-Spark Connector

Using the Greenplum-Spark Connector

源文档无正文。

原文:<https://www.bookstack.cn/read/Greenplum-5.29-en/186b8f8fda106d59.md>

上一篇:
下一篇:
  • 书签
  • 添加书签 移除书签
  • Version 5.29
  • Release Notes
  • Installation Guide
    • Introduction to Greenplum
    • Estimating Storage Capacity
    • Configuring Your Systems and Installing Greenplum
    • Verifying the VMware Tanzu Greenplum Software Download
    • Validating Your Systems
    • Initializing a Greenplum Database System
    • Installing Optional Extensions
      • Procedural Language, Machine Learning, and Geospatial Extensions
      • Python Data Science Module Package
      • R Data Science Library Package
      • Greenplum Platform Extension Framework (PXF)
      • Oracle Compatibility Functions
      • dblink Connectivity Functions
      • pgcrypto Cryptographic Functions
    • Configuring Timezone and Localization Settings
    • About Implicit Text Casting in Greenplum Database
    • Installation Management Utilities
    • Greenplum Environment Variables
  • Greenplum Database Best Practices
    • Best Practices Summary
    • System Configuration
    • Schema Design
    • Memory and Resource Management with Resource Groups
    • Memory and Resource Management with Resource Queues
    • System Monitoring and Maintenance
      • Updating Statistics with ANALYZE
      • Managing Bloat in the Database
      • Monitoring Greenplum Database Log Files
    • Loading Data
    • Migrating Data with gptransfer
    • Security
    • Encrypting Data and Database Connections
    • Tuning SQL Queries
    • High Availability
  • Cloud Technical Recommendations
  • Greenplum Database Security Configuration Guide
    • Securing the Database
    • Greenplum Database Ports and Protocols
    • Configuring Client Authentication
    • Configuring Database Authorization
    • Greenplum Command Center Security
    • Auditing
    • Encrypting Data and Database Connections
    • Enabling gphdfs Authentication with a Kerberos-secured Hadoop Cluster (Deprecated)
    • Security Best Practices
  • System Administration
    • Greenplum Database Concepts
      • About the Greenplum Architecture
      • About Management and Monitoring Utilities
      • About Concurrency Control in Greenplum Database
        • Example of Managing Transaction IDs
      • About Parallel Data Loading
      • About Redundancy and Failover in Greenplum Database
      • About Database Statistics in Greenplum Database
    • Managing a Greenplum System
      • About the Greenplum Database Release Version Number
      • Starting and Stopping Greenplum Database
      • Accessing the Database
        • Establishing a Database Session
        • Supported Client Applications
        • Greenplum Database Client Applications
        • Connecting with psql
        • Using the PgBouncer Connection Pooler
        • Database Application Interfaces
        • Troubleshooting Connection Problems
      • Configuring the Greenplum Database System
        • About Greenplum Database Master and Local Parameters
        • Setting Configuration Parameters
          • Setting a Local Configuration Parameter
          • Setting a Master Configuration Parameter
            • Setting Parameters at the System Level
            • Setting Parameters at the Database Level
            • Setting Parameters at the Role Level
            • Setting Parameters in a Session
        • Viewing Server Configuration Parameter Settings
        • Configuration Parameter Categories
          • Connection and Authentication Parameters
            • Connection Parameters
            • Security and Authentication Parameters
          • System Resource Consumption Parameters
            • Memory Consumption Parameters
            • Free Space Map Parameters
            • OS Resource Parameters
            • Cost-Based Vacuum Delay Parameters
            • Transaction ID Management Parameters
          • Query Tuning Parameters
            • GPORCA Configuration Parameters
            • Query Plan Operator Control Parameters
            • Legacy Query Optimizer Costing Parameters
            • Database Statistics Sampling Parameters
            • Sort Operator Configuration Parameters
            • Aggregate Operator Configuration Parameters
            • Join Operator Configuration Parameters
            • Other Legacy Query Optimizer Configuration Parameters
          • Error Reporting and Logging Parameters
            • Log Rotation
            • When to Log
            • What to Log
          • System Monitoring Parameters
            • SNMP Alerts
            • Email Alerts
            • Greenplum Command Center Agent
          • Runtime Statistics Collection Parameters
          • Automatic Statistics Collection Parameters
          • Client Connection Default Parameters
            • Statement Behavior Parameters
            • Locale and Formatting Parameters
            • Other Client Default Parameters
          • Lock Management Parameters
          • Resource Management Parameters
          • External Table Parameters
          • Database Table Parameters
          • Database and Tablespace/Filespace Parameters
          • Past Version Compatibility Parameters
          • Greenplum Array Configuration Parameters
            • Interconnect Configuration Parameters
            • Dispatch Configuration Parameters
            • Fault Operation Parameters
            • Distributed Transaction Management Parameters
            • Read-Only Parameters
          • Greenplum Master and Segment Mirroring Parameters
          • Greenplum Database Extension Parameters
      • Enabling High Availability and Data Consistency Features
        • Overview of Greenplum Database High Availability
          • Overview of Segment Mirroring
          • Overview of Master Mirroring
          • Overview of Fault Detection and Recovery
        • Enabling Mirroring in Greenplum Database
          • Enabling Segment Mirroring
          • Enabling Master Mirroring
        • Detecting a Failed Segment
          • Enabling Alerts and Notifications
          • Checking for Failed Segments
          • Checking the Log Files for Failed Segments
        • Recovering a Failed Segment
          • Recovering From Segment Failures
            • When a segment host is not recoverable
            • About the Segment Recovery Process
        • Recovering a Failed Master
          • Restoring Master Mirroring After a Recovery
      • Backing Up and Restoring Databases
        • Backup and Restore Overview
        • Parallel Backup with gpcrondump and gpdbrestore
          • Backup and Restore Options
          • Backing Up with gpcrondump
          • Backing Up a Set of Tables
          • Creating Incremental Backups
          • Backup Process and Locks
          • Using Direct I/O
          • Using Named Pipes
          • Backing Up Databases with Data Domain Boost
          • Backing Up Databases with Veritas NetBackup
          • Restoring Greenplum Databases
          • Restoring a Database Using gpdbrestore
          • Restoring to a Different Greenplum System Configuration
        • Parallel Backup with gpbackup and gprestore
          • Creating Incremental Backups with gpbackup and gprestore
          • Using gpbackup and gprestore with BoostFS
          • Using gpbackup Storage Plugins
            • Using the S3 Storage Plugin with gpbackup and gprestore
            • Using the DD Boost Storage Plugin with gpbackup and gprestore
              • Replicating Backups
          • Backup/Restore Storage Plugin API (Beta)
            • backup_data
            • backup_file
            • cleanup_plugin_for_backup
            • cleanup_plugin_for_restore
            • plugin_api_version
            • restore_data
            • restore_file
            • setup_plugin_for_backup
            • setup_plugin_for_restore
      • Expanding a Greenplum System
        • System Expansion Overview
        • Planning Greenplum System Expansion
        • Preparing and Adding Nodes
        • Initializing New Segments
        • Redistributing Tables
        • Removing the Expansion Schema
      • Migrating Data
        • Migrating Data with gpcopy
        • Migrating Data with gptransfer
      • Monitoring a Greenplum System
      • Routine System Maintenance Tasks
      • Recommended Monitoring and Maintenance Tasks
    • Managing Greenplum Database Access
      • Configuring Client Authentication
        • Using LDAP Authentication with TLS/SSL
        • Using Kerberos Authentication
        • Configuring Kerberos for Linux Clients
        • Configuring Kerberos For Windows Clients
      • Managing Roles and Privileges
    • Defining Database Objects
      • Creating and Managing Databases
      • Creating and Managing Tablespaces
      • Creating and Managing Schemas
      • Creating and Managing Tables
      • Choosing the Table Storage Model
      • Partitioning Large Tables
      • Creating and Using Sequences
      • Using Indexes in Greenplum Database
      • Creating and Managing Views
        • Best Practices when Creating Views
        • Working with View Dependencies
        • About View Storage in Greenplum Database
    • Distribution and Skew
    • Inserting, Updating, and Deleting Data
    • Querying Data
      • About Greenplum Query Processing
      • About GPORCA
        • Overview of GPORCA
        • Enabling and Disabling GPORCA
        • Collecting Root Partition Statistics
        • Considerations when Using GPORCA
        • GPORCA Features and Enhancements
        • Changed Behavior with the GPORCA
        • GPORCA Limitations
        • Determining the Query Optimizer that is Used
        • About Uniform Multi-level Partitioned Tables
      • Defining Queries
      • WITH Queries (Common Table Expressions)
      • Using Functions and Operators
      • Working with JSON Data
      • Working with XML Data
      • Query Performance
      • Managing Spill Files Generated by Queries
      • Query Profiling
    • Working with External Data
      • Defining External Tables
        • file:// Protocol
        • gpfdist:// Protocol
        • gpfdists:// Protocol
        • gphdfs:// Protocol (Deprecated)
        • pxf:// Protocol
        • s3:// Protocol
        • Using a Custom Protocol
        • Handling Errors in External Table Data
        • Creating and Using External Web Tables
        • Examples for Creating External Tables
          • Example 1—Single gpfdist instance on single-NIC machine
          • Example 2—Multiple gpfdist instances
          • Example 3—Multiple gpfdists instances
          • Example 4—Single gpfdist instance with error logging
          • Example 5—TEXT Format on a Hadoop Distributed File Server
          • Example 6—Multiple files in CSV format with header rows
          • Example 7—Readable External Web Table with Script
          • Example 8—Writable External Table with gpfdist
          • Example 9—Writable External Web Table with Script
          • Example 10—Readable and Writable External Tables with XML Transformations
      • Accessing HDFS Data with gphdfs (Deprecated)
        • One-time gphdfs Protocol Installation (Deprecated)
        • Grant Privileges for the gphdfs Protocol (Deprecated)
        • Specify gphdfs Protocol in an External Table Definition (Deprecated)
        • gphdfs Support for Avro Files (Deprecated)
        • gphdfs Support for Parquet Files (Deprecated)
        • HDFS Readable and Writable External Table Examples (Deprecated)
        • Reading and Writing Custom-Formatted HDFS Data with gphdfs (Deprecated)
        • Using Amazon EMR with Greenplum Database installed on AWS (Deprecated)
      • Using the Greenplum Parallel File Server (gpfdist)
    • Loading and Unloading Data
      • Loading Data Using an External Table
      • Loading and Writing Non-HDFS Custom Data
        • Using a Custom Format
          • Importing and Exporting Fixed Width Data
          • Examples: Read Fixed-Width Data
        • Using a Custom Protocol
      • Handling Load Errors
        • Define an External Table with Single Row Error Isolation
        • Capture Row Formatting Errors and Declare a Reject Limit
        • Viewing Bad Rows in the Error Log
        • Identifying Invalid CSV Files in Error Table Data
        • Moving Data between Tables
      • Loading Data with gpload
      • Accessing External Data with PXF
      • Loading Kafka Data with the Greenplum-Kafka Integration
      • Loading Data with the Greenplum Streaming Server
      • Using the Greenplum-Spark Connector
      • Using the Greenplum-Informatica Connector
      • Transforming External Data with gpfdist and gpload
      • Loading Data with COPY
      • Running COPY in Single Row Error Isolation Mode
      • Optimizing Data Load and Query Performance
      • Unloading Data from Greenplum Database
        • Defining a File-Based Writable External Table
          • Example 1—Greenplum file server (gpfdist)
          • Example 2—Hadoop file server (gphdfs (Deprecated))
        • Defining a Command-Based Writable External Web Table
          • Disabling EXECUTE for Web or Writable External Tables
        • Unloading Data Using a Writable External Table
        • Unloading Data Using COPY
      • Formatting Data Files
        • Formatting Rows
        • Formatting Columns
        • Representing NULL Values
        • Escaping
          • Escaping in Text Formatted Files
          • Escaping in CSV Formatted Files
        • Character Encoding
      • Example Custom Data Access Protocol
        • Installing the External Table Protocol
          • gpextprotocal.c
    • Managing Performance
      • Defining Database Performance
      • Common Causes of Performance Issues
      • Greenplum Database Memory Overview
      • Managing Resources
        • Using Resource Groups
        • Using Resource Queues
      • Investigating a Performance Problem
  • Reference Guide
    • SQL Command Reference
      • SQL Syntax Summary
      • ABORT
      • ALTER AGGREGATE
      • ALTER CONVERSION
      • ALTER DATABASE
      • ALTER DOMAIN
      • ALTER EXTENSION
      • ALTER EXTERNAL TABLE
      • ALTER FILESPACE
      • ALTER FUNCTION
      • ALTER GROUP
      • ALTER INDEX
      • ALTER LANGUAGE
      • ALTER OPERATOR
      • ALTER OPERATOR CLASS
      • ALTER OPERATOR FAMILY
      • ALTER PROTOCOL
      • ALTER RESOURCE GROUP
      • ALTER RESOURCE QUEUE
      • ALTER ROLE
      • ALTER SCHEMA
      • ALTER SEQUENCE
      • ALTER TABLE
      • ALTER TABLESPACE
      • ALTER TYPE
      • ALTER USER
      • ALTER VIEW
      • ANALYZE
      • BEGIN
      • CHECKPOINT
      • CLOSE
      • CLUSTER
      • COMMENT
      • COMMIT
      • COPY
      • CREATE AGGREGATE
      • CREATE CAST
      • CREATE CONVERSION
      • CREATE DATABASE
      • CREATE DOMAIN
      • CREATE EXTENSION
      • CREATE EXTERNAL TABLE
      • CREATE FUNCTION
      • CREATE GROUP
      • CREATE INDEX
      • CREATE LANGUAGE
      • CREATE OPERATOR
      • CREATE OPERATOR CLASS
      • CREATE OPERATOR FAMILY
      • CREATE PROTOCOL
      • CREATE RESOURCE GROUP
      • CREATE RESOURCE QUEUE
      • CREATE ROLE
      • CREATE RULE
      • CREATE SCHEMA
      • CREATE SEQUENCE
      • CREATE TABLE
      • CREATE TABLE AS
      • CREATE TABLESPACE
      • CREATE TYPE
      • CREATE USER
      • CREATE VIEW
      • DEALLOCATE
      • DECLARE
      • DELETE
      • DISCARD
      • DO
      • DROP AGGREGATE
      • DROP CAST
      • DROP CONVERSION
      • DROP DATABASE
      • DROP DOMAIN
      • DROP EXTENSION
      • DROP EXTERNAL TABLE
      • DROP FILESPACE
      • DROP FUNCTION
      • DROP GROUP
      • DROP INDEX
      • DROP LANGUAGE
      • DROP OPERATOR
      • DROP OPERATOR CLASS
      • DROP OPERATOR FAMILY
      • DROP OWNED
      • DROP PROTOCOL
      • DROP RESOURCE GROUP
      • DROP RESOURCE QUEUE
      • DROP ROLE
      • DROP RULE
      • DROP SCHEMA
      • DROP SEQUENCE
      • DROP TABLE
      • DROP TABLESPACE
      • DROP TYPE
      • DROP USER
      • DROP VIEW
      • END
      • EXECUTE
      • EXPLAIN
      • FETCH
      • GRANT
      • INSERT
      • LOAD
      • LOCK
      • MOVE
      • PREPARE
      • REASSIGN OWNED
      • REINDEX
      • RELEASE SAVEPOINT
      • RESET
      • REVOKE
      • ROLLBACK
      • ROLLBACK TO SAVEPOINT
      • SAVEPOINT
      • SELECT
      • SELECT INTO
      • SET
      • SET ROLE
      • SET SESSION AUTHORIZATION
      • SET TRANSACTION
      • SHOW
      • START TRANSACTION
      • TRUNCATE
      • UPDATE
      • VACUUM
      • VALUES
    • SQL 2008 Optional Feature Compliance
    • Greenplum Environment Variables
    • System Catalog Reference
      • System Tables
      • System Views
      • System Catalogs Definitions
        • gp_configuration_history
        • gp_distributed_log
        • gp_distributed_xacts
        • gp_distribution_policy
        • gpexpand.expansion_progress
        • gpexpand.status
        • gpexpand.status_detail
        • gp_fastsequence
        • gp_fault_strategy
        • gp_global_sequence
        • gp_id
        • gp_persistent_database_node
        • gp_persistent_filespace_node
        • gp_persistent_relation_node
        • gp_persistent_tablespace_node
        • gp_pgdatabase
        • gp_relation_node
        • gp_resgroup_config
        • gp_resgroup_status
        • gp_resqueue_status
        • gp_segment_configuration
        • gp_transaction_log
        • gp_version_at_initdb
        • pg_aggregate
        • pg_am
        • pg_amop
        • pg_amproc
        • pg_appendonly
        • pg_attrdef
        • pg_attribute
        • pg_attribute_encoding
        • pg_auth_members
        • pg_authid
        • pg_available_extension_versions
        • pg_available_extensions
        • pg_cast
        • pg_class
        • pg_compression
        • pg_constraint
        • pg_conversion
        • pg_database
        • pg_depend
        • pg_description
        • pg_enum
        • pg_extension
        • pg_exttable
        • pg_filespace
        • pg_filespace_entry
        • pg_index
        • pg_inherits
        • pg_language
        • pg_largeobject
        • pg_listener
        • pg_locks
        • pg_max_external_files
        • pg_namespace
        • pg_opclass
        • pg_operator
        • pg_partition
        • pg_partition_columns
        • pg_partition_encoding
        • pg_partition_rule
        • pg_partition_templates
        • pg_partitions
        • pg_pltemplate
        • pg_proc
        • pg_resgroup
        • pg_resgroupcapability
        • pg_resourcetype
        • pg_resqueue
        • pg_resqueue_attributes
        • pg_resqueuecapability
        • pg_rewrite
        • pg_roles
        • pg_shdepend
        • pg_shdescription
        • pg_stat_activity
        • pg_stat_all_indexes
        • pg_stat_all_tables
        • pg_stat_last_operation
        • pg_stat_last_shoperation
        • pg_stat_operations
        • pg_stat_partition_operations
        • pg_stat_replication
        • pg_statistic
        • pg_stat_resqueues
        • pg_tablespace
        • pg_trigger
        • pg_type
        • pg_type_encoding
        • pg_user_mapping
        • pg_window
    • The gp_toolkit Administrative Schema
    • The gpperfmon Database
      • database_*
      • diskspace_*
      • interface_stats_*
      • log_alert_*
      • queries_*
      • segment_*
      • socket_stats_*
      • system_*
      • dynamic_memory_info
      • memory_info
    • Greenplum Database Data Types
    • Character Set Support
    • Server Configuration Parameters
      • Parameter Categories
      • Configuration Parameters
    • Summary of Built-in Functions
    • Greenplum MapReduce Specification
    • Greenplum PL/pgSQL Procedural Language
    • Greenplum PostGIS Extension
    • Greenplum PL/R Language Extension
    • Greenplum PL/Python Language Extension
    • PL/Container Language
    • Greenplum PL/Java Language Extension
    • Greenplum PL/Perl Language Extension
    • Greenplum MADlib Extension for Analytics
    • Greenplum Partner Connector API
    • Greenplum Fuzzy String Match Extension
    • Summary of Greenplum Features
  • Utility Guide
    • Management Utility Reference
      • analyzedb
      • gpactivatestandby
      • gpaddmirrors
      • gpbackup
      • gpcheck
      • gpcheckcat
      • gpcheckperf
      • gpconfig
      • gpcrondump
      • gpdbrestore
      • gpcopy
      • gpdeletesystem
      • gpexpand
      • gpfdist
      • gpfilespace
      • gpinitstandby
      • gpinitsystem
      • gpkafka
      • gpload
      • gplogfilter
      • gpmapreduce
      • gpmfr
      • gpmovemirrors
      • gpmt
      • gpperfmon_install
      • gppkg
      • gprecoverseg
      • gpreload
      • gprestore
      • gpscp
      • gpseginstall
      • gpssh
      • gpss
      • gpssh-exkeys
      • gpstart
      • gpstate
      • gpstop
      • gpsys1
      • gptransfer
      • pgbouncer
      • pgbouncer.ini
      • pgbouncer-admin
      • plcontainer
      • plcontainer Configuration File
    • Client Utility Reference
      • clusterdb
      • createdb
      • createlang
      • createuser
      • dropdb
      • droplang
      • dropuser
      • pg_config
      • pg_dump
      • pg_dumpall
      • pg_restore
      • psql
      • reindexdb
      • vacuumdb
    • Additional Supplied Modules
      • citext Data Type
      • dblink Functions
      • hstore Functions
      • Oracle Compatibility Functions
  • UNIX Client Documentation
    • Client Tools for UNIX
      • Installing the Greenplum Client Tools
      • Client Tools Reference
    • Load Tools for UNIX
      • Installing the Greenplum Load Tools
      • Load Tools Reference
  • Windows Client Documentation
    • Client Tools for Windows
      • Installing the Greenplum Client Tools
      • Running the Greenplum Client Tools
      • Client Tools Reference
    • Load Tools for Windows
      • Installing Greenplum Loader
      • Running Greenplum Loader
      • Running gpfdist as a Windows Service
      • Loader Program Reference
  • DataDirect ODBC Drivers for Tanzu Greenplum
  • DataDirect JDBC Driver for Tanzu Greenplum
  • Versions 5.28 and Older Docs
暂无相关搜索结果!

    本文档使用 WanXiangYunDang 构建

    展开/收起文章目录

    思维导图备注

    文章二维码

    手机扫一扫,轻松掌上读

    文档下载

    请下载您需要的格式的文档,随时随地,享受汲取知识的乐趣!
    PDF文档 EPUB文档 MOBI文档

    微信小程序阅读

    BookChat 微信小程序阅读
    微信扫一扫,知识掌上学

    书签列表

      阅读记录

      阅读进度: 0.00% ( 0/0 ) 重置阅读进度