Skip to content

[Bug] pipe data.delete error #17816

Open
Open

Description

@zhaoyanganddingru

Search before asking

  • I searched in the issues and found nothing similar.

Version

os: rh9.2 iotdb 2.0.5 use table

Describe the bug and provide the minimal reproduce step

create pipe DA
with source (
'database-name'='nezha',
'mode.snapshot'='false',
'mode.streaming'='true',
'inclusion'='data.insert,data.delete',
)
with sink (
'sink'='iotdb-thrift-sink',
'node-urls' = '127.0.0.1:6669', -- 目标端 IoTDB 中 DataNode 节点的数据服务端口的 url
'username'='root',
'password'='xxxxxxxxxxx'
);

当我删除数据的时候pipe会直接报错并进入状态 stop

What did you expect to see?

Data is synchronizing normally

What did you see instead?

pipe error

Anything else?

No response

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Activity

  1. zhaoyanganddingru commented on Jun 2, 2026

    @zhaoyanganddingru
    Author

    |DA|2026-01-26T13:14:13.483|STOPPED|{_system.sql-dialect=table, inclusion=data.insert,data.delete, mode.snapshot=false, mode.streaming=true, source.password=, source.username=root}| {}|{node-urls=127.0.0.1:6669, password=, sink=iotdb-thrift-sink, username=root}|regionIds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16], 2026-01-26T13:15:05.190, Exception in pipe transfer, subtask: data{node-urls=127.0.0.1:6669, password=, realtime-first=false, sink=iotdb-thrift-sink, username=root}_1769404453483_10, last event: PipeDeleteDataNodeEvent{progressIndex=null, isGeneratedByPipe=false} - EnrichedEvent{referenceCount=1, isReleased=false, pipeName='DA', committerKey='CommitterKey{pipeName=DA, creationTime=1769404453483, regionId=7, restartTimes=0}', commitId=3', replicateIndexForIoTV2=-1, treePattern='IoTDBPipePattern{pattern='root.**', isTreeModelDataAllowedToBeCaptured=false}', tablePattern='TablePattern{isTableModelDataAllowedToBeCaptured=true, databasePattern=null, tablePattern=null}', startTime=-9223372036854775808, endTime=9223372036854775807, isPatternParsed=true, isTimeParsed=true, shouldReportOnCommit=true, userName=root, skipIfNoPrivileges=true}, root cause: Cannot invoke "org.apache.iotdb.db.pipe.consensus.deletion.DeletionResource.toString()" because the return value of "org.apache.iotdb.db.pipe.event.common.deletion.PipeDeleteDataNodeEvent.getDeletionResource()" is null| 0| 0.00|

  2. Caideyipi commented on Jun 2, 2026

    @Caideyipi
    Collaborator

    The NPE is fixed by this PR: #17457
    Then you can see the actual report of this problem covered by the NPE

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions