[Bug] In the Flink scheme for synchronizing Doris across the entire SQL Server database, the -- table conf table partitions were set but did not take effect

[blackstarstar007]

Search before asking

• I had searched in the issues and found no similar issues.

Version

jar包版本：flink-doris-connector-1.20-25.0.0.jar
doris版本：apache-doris-2.1.7-bin-x64-noavx2

What's Wrong?

flink整库同步脚本
sqlserver-sync-database
--job-name ods-lims-tt-to-doris-1000
--database test
--table-prefix ods_
--table-conf replication_num=1
--table-conf table-partitions="Test_BaseInfo:GiveDate:month"
--sqlserver-conf schema-name=TT
--including-tables "Test_BaseInfo"
--sink-conf sink.label-prefix=label_ods_lis_1000_1
${lims_sqlserver_conf_1000}
${doris_sink_conf}

sqlserver原表结构
CREATE TABLE [TT].[Test_BaseInfo] (
[ID] bigint NOT NULL,
[Hospital] varchar(8) COLLATE Chinese_PRC_CI_AS NULL,
[HospitalName] varchar(128) COLLATE Chinese_PRC_CI_AS NULL,
[PatientName] nvarchar(64) COLLATE Chinese_PRC_CI_AS NULL,
[Sex] varchar(1) COLLATE Chinese_PRC_CI_AS NULL,
[SexName] varchar(10) COLLATE Chinese_PRC_CI_AS NULL,
[PatientAge] varchar(13) COLLATE Chinese_PRC_CI_AS NULL,
[PatientAgeDisplay] varchar(32) COLLATE Chinese_PRC_CI_AS NULL,
[AgeBirthDay] date NULL,
[BedNo] varchar(128) COLLATE Chinese_PRC_CI_AS NULL,
[PatientNo] varchar(32) COLLATE Chinese_PRC_CI_AS NULL,
[HosDepartment] varchar(225) COLLATE Chinese_PRC_CI_AS NULL,
[SampleCollectionTime] datetime NULL,
[PatientType] varchar(16) COLLATE Chinese_PRC_CI_AS NULL,
[PatientTypeName] varchar(48) COLLATE Chinese_PRC_CI_AS NULL,
[ClinicalDiagnosis] varchar(1024) COLLATE Chinese_PRC_CI_AS NULL,
[DoctorName] varchar(32) COLLATE Chinese_PRC_CI_AS NULL,
[HosBarcode] varchar(32) COLLATE Chinese_PRC_CI_AS NULL,
[PatientPhone] varchar(64) COLLATE Chinese_PRC_CI_AS NULL,
[PatientAddress] varchar(128) COLLATE Chinese_PRC_CI_AS NULL,
[PatientCardNo] varchar(32) COLLATE Chinese_PRC_CI_AS NULL,
[Weight] varchar(128) COLLATE Chinese_PRC_CI_AS NULL,
[BirthAge] varchar(20) COLLATE Chinese_PRC_CI_AS NULL,
[LastMenstrual] date NULL,
[PeriodMenstrual] varchar(32) COLLATE Chinese_PRC_CI_AS NULL,
[FetusCount] varchar(16) COLLATE Chinese_PRC_CI_AS NULL,
[IsSmoke] bit NULL,
[IsExternalingravIdation] int NULL,
[IsDiabetes] int NULL,
[IsBadnessPregnant] int NULL,
[Race] int NULL,
[PathologyNo] varchar(16) COLLATE Chinese_PRC_CI_AS NULL,
[ElectricMirrorNo] varchar(20) COLLATE Chinese_PRC_CI_AS NULL,
[IsUrgent] int NULL,
[BPD] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[BTime] datetime NULL,
[CRL] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[BGestateWeeks] varchar(500) COLLATE Chinese_PRC_CI_AS NULL,
[CGestateWeeks] varchar(500) COLLATE Chinese_PRC_CI_AS NULL,
[Guardian] varchar(20) COLLATE Chinese_PRC_CI_AS NULL,
[HealthCare] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[IsCurettage] int NULL,
[IsHormonotherapy] int NULL,
[IsMarital] int NULL,
[PathologyDiagnose] varchar(512) COLLATE Chinese_PRC_CI_AS NULL,
[SpouseAge] varchar(20) COLLATE Chinese_PRC_CI_AS NULL,
[SpouseName] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[DoctorPhone] varchar(32) COLLATE Chinese_PRC_CI_AS NULL,
[FinOrgCode] varchar(10) COLLATE Chinese_PRC_CI_AS NULL,
[SalesMan] varchar(32) COLLATE Chinese_PRC_CI_AS NULL,
[SalesManCode] varchar(32) COLLATE Chinese_PRC_CI_AS NULL,
[HospitalAgenctCode] varchar(128) COLLATE Chinese_PRC_CI_AS NULL,
[CMLDateTime] varchar(150) COLLATE Chinese_PRC_CI_AS NULL,
[DiseaseStage] int NULL,
[IsCML] int NULL,
[IsTKI] int NULL,
[PCRNumber] int NULL,
[TKIDateTime] datetime NULL,
[TKIPreparation] varchar(128) COLLATE Chinese_PRC_CI_AS NULL,
[IsAbnormal] bit NULL,
[ContinuousDateTime] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[ApplyID] varchar(128) COLLATE Chinese_PRC_CI_AS NULL,
[ApplyPeople] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[BodyName] varchar(64) COLLATE Chinese_PRC_CI_AS NULL,
[CandleCount] int NULL,
[ClinicHistory] varchar(64) COLLATE Chinese_PRC_CI_AS NULL,
[CutCandleCount] int NULL,
[DoctorEmail] varchar(56) COLLATE Chinese_PRC_CI_AS NULL,
[FixLiquid] varchar(100) COLLATE Chinese_PRC_CI_AS NULL,
[FixTime] int NULL,
[GeneType] varchar(20) COLLATE Chinese_PRC_CI_AS NULL,
[HBV] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[HCV] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[HIV] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[LeaveBodyTime] int NULL,
[MarkeThing] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[Nation] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[PerRlevelinfoId] int NULL,
[PPD] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[RandomCode] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[CuttingPart] varchar(32) COLLATE Chinese_PRC_CI_AS NULL,
[ParaffinBlockCount] varchar(8) COLLATE Chinese_PRC_CI_AS NULL,
[SampleCount] int NULL,
[IsSampleUrgent] int NULL,
[Barcode] varchar(16) COLLATE Chinese_PRC_CI_AS NULL,
[InputOrder] smallint DEFAULT ((0)) NOT NULL,
[IsHaveAbnormal] bit DEFAULT ((0)) NOT NULL,
[SamplingSpot] varchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[GestationalAge] varchar(20) COLLATE Chinese_PRC_CI_AS NULL,
[GiveDate] datetime DEFAULT (getdate()) NULL,
[TimeStamp] timestamp NOT NULL,
[AffiliatedGroup] varchar(10) COLLATE Chinese_PRC_CI_AS DEFAULT ((1000)) NULL,
[ExcelPutId] bigint NULL,
[SendLab] nvarchar(10) COLLATE Chinese_PRC_CI_AS NULL,
[SettlementType] int NULL,
[InputMode] varchar(20) COLLATE Chinese_PRC_CI_AS NULL,
[PayState] bit NULL,
[OpenID] nvarchar(50) COLLATE Chinese_PRC_CI_AS NULL,
[SaleCode] nvarchar(20) COLLATE Chinese_PRC_CI_AS NULL,
[TimingOfDetectionCode] varchar(16) COLLATE Chinese_PRC_CI_AS NULL,
[TimingOfDetectionName] varchar(32) COLLATE Chinese_PRC_CI_AS NULL,
[CrowdClassify] varchar(64) COLLATE Chinese_PRC_CI_AS NULL,
[OpenPackageTime] datetime NULL,
[CollaborationGroupNo] varchar(20) COLLATE Chinese_PRC_CI_AS NULL,
[PatientMail] varchar(64) COLLATE Chinese_PRC_CI_AS NULL,
[IsJKWH] bit NULL,
[IsSB] bit NULL,
[CollectionType] varchar(16) COLLATE Chinese_PRC_CI_AS NULL,
[TreatmentHistory] varchar(1024) COLLATE Chinese_PRC_CI_AS NULL,
[FocusDiseaseOrGeneticInformation] varchar(1024) COLLATE Chinese_PRC_CI_AS NULL,
[MedicalRecord] varchar(1024) COLLATE Chinese_PRC_CI_AS NULL,
[IsTransport] bit NULL,
[IsTransport1] bit DEFAULT ((0)) NULL,
[IsTransport2] bit DEFAULT ((0)) NOT NULL,
[ClinicalPathogenTestResults] nvarchar(256) COLLATE Chinese_PRC_CI_AS NULL,
[ClinicalSymptoms] nvarchar(256) COLLATE Chinese_PRC_CI_AS NULL,
[FocusOnDisease] nvarchar(256) COLLATE Chinese_PRC_CI_AS NULL,
[AgentCode] varchar(16) COLLATE Chinese_PRC_CI_AS NULL,
[AgentName] varchar(128) COLLATE Chinese_PRC_CI_AS NULL,
[CollaborationGroupName] varchar(128) COLLATE Chinese_PRC_CI_AS NULL,
[ChiefComplaint] varchar(225) COLLATE Chinese_PRC_CI_AS NULL,
[WhiteBloodCellCount] varchar(225) COLLATE Chinese_PRC_CI_AS NULL,
[PercentageOfNeutrophils] varchar(225) COLLATE Chinese_PRC_CI_AS NULL,
[LymphocytePercentage] varchar(225) COLLATE Chinese_PRC_CI_AS NULL,
[PCT] varchar(225) COLLATE Chinese_PRC_CI_AS NULL,
[CRP] varchar(225) COLLATE Chinese_PRC_CI_AS NULL,
[TrainingAppraisalResults] varchar(225) COLLATE Chinese_PRC_CI_AS NULL,
[AntigenAntibodyTesting] varchar(225) COLLATE Chinese_PRC_CI_AS NULL,
[G_GmTest] varchar(225) COLLATE Chinese_PRC_CI_AS NULL,
[PCRDetection] varchar(225) COLLATE Chinese_PRC_CI_AS NULL,
[GroupOrderRemark] varchar(256) COLLATE Chinese_PRC_CI_AS NULL,
[Genetichistory] nvarchar(256) COLLATE Chinese_PRC_CI_AS NULL,
[Medicationusage] nvarchar(256) COLLATE Chinese_PRC_CI_AS NULL,
[SettlementMethod] int DEFAULT ((0)) NOT NULL,
[SecondPageCode] varchar(20) COLLATE Chinese_PRC_CI_AS NULL,
[PatientSort] int NULL,
CONSTRAINT [PK_Test_BaseInfo] PRIMARY KEY CLUSTERED ([ID])
WITH (PAD_INDEX = OFF, FILLFACTOR = 90, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON)
ON [PRIMARY],
CONSTRAINT [CK_Test_BaseInfo_AgeBirthDay] CHECK ([AgeBirthDay]<=CONVERT([varchar],getdate(),(120)))
)
ON [PRIMARY]
GO
整库同步中自动分区GiveDate属性未生效，是因为GiveDate字段在源表中不是主键的原因吗，

以下截图生成的generateCreateTableDDL

What You Expected?

整库同步方案中，--table-conf table-partitions="Test_BaseInfo:GiveDate:month"可以根据指定的特性生成分区列

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct