控制字符删除

您可以使用多种阶段来从数据中删除控制字符,例如转义符或传输结束符。删除控制字符,以避免创建无效的记录。

Data Collector删除控制字符时,它将删除ASCII字符代码0-31和127,但以下情况除外:

  • 9-Tab
  • 10-换行
  • 13-回车
您可以在以下阶段中使用“Ignore Ctrl Characters属性来删除控制字符:
  • Amazon S3 origin
  • Amazon SQS Consumer origin
  • Azure Data Lake Storage Gen1 origin
  • Azure Data Lake Storage Gen2 origin
  • Azure IoT/Event Hub Consumer origin
  • CoAP Server origin
  • Directory origin
  • File Tail origin
  • Google Cloud Storage origin
  • Google Pub/Sub Subscriber origin
  • gRPC Client origin
  • Hadoop FS origin
  • Hadoop FS Standalone origin
  • HTTP Client origin
  • HTTP Server origin
  • JMS Consumer origin
  • Kafka Consumer origin
  • Kafka Multitopic Consumer origin
  • Kinesis Consumer origin
  • MapR FS origin
  • MapR FS Standalone origin
  • MapR Multitopic Streams Consumer origin
  • MapR Streams Consumer origin
  • MQTT Subscriber origin
  • Pulsar Consumer origin
  • RabbitMQ Consumer origin
  • Redis Consumer origin
  • SFTP/FTP/FPTS Client origin
  • TCP Server origin
  • WebSocket Client origin
  • WebSocket Server origin
  • Data Parser processor
  • HTTP Client processor
  • JSON Parser processor
  • Log Parser processor
  • XML Parser processor