<dev>

1. 修改脚本

src/main/resources/application.yml

 # 查询日志起始
-start_time: "2020-11-07 21:22:20"
+start_time: "2021-02-26 00:00:20"
 # 查询日志结束
-end_time: "2020-11-07 23:40:30"
+end_time: "2021-02-26 23:59:59"
 
 # 任务配置
 job_name: "国泰交易日志脱敏job"
@@ -46,9 +46,9 @@ hdfs_uri: "hdfs://cdh-2:8020/"
 # hdfs 用户名
 hdfs_user: "hdfs"
 # hdfs日志源文件地址，若source为hdfs，则该地址必传，必须以斜杠结尾
-hdfs_src: "/tmp/datawarehouse4/jzjy/kcbp_biz_log/"
+hdfs_src: "/tmp/datawarehouse/net22/"
 # hdfs日志写入地址，非必传，默认写到hdfs-src目录下的output目录下，必须以斜杠结尾
-hdfs_dest: "/tmp/datawarehouse/jzjy/kcbp_biz_log/output4/"
+hdfs_dest: "/tmp/datawarehouse/net22/output2/"
 
 # cdh下载配置
 # cdh能执行hdfs命令的机器的ip

src/main/resources/bin/start.sh

@@ -9,4 +9,4 @@ if [ ! -d "$DEPLOY_PATH/logs" ]; then
   mkdir -p $DEPLOY_PATH/logs
 fi
 
-flink run -d -c com.zorkdata.desensitization.TransactionLogDesensitization $DEPLOY_PATH/lib/transaction-log-desensitization-0.1.jar --conf $DEPLOY_PATH/conf/$FLINK_TASK_CONF --regular $DEPLOY_PATH/conf/$REGULAR_TASK_NAME > $DEPLOY_PATH/logs/submit.log &
+flink run -d -c com.zorkdata.desensitization.TransactionLogDesensitization $DEPLOY_PATH/lib/transaction-log-desensitization-0.1.jar --conf $DEPLOY_PATH/conf/$FLINK_TASK_CONF > $DEPLOY_PATH/logs/submit.log &

src/main/resources/bin/start_and_download.sh

@@ -61,7 +61,7 @@ done < $DEPLOY_PATH/conf/$FLINK_TASK_CONF
 echo "开始提交任务"
 
 
-flink run -d -c com.zorkdata.desensitization.TransactionLogDesensitization $DEPLOY_PATH/lib/transaction-log-desensitization-0.1.jar --conf $DEPLOY_PATH/conf/$FLINK_TASK_CONF --regular $DEPLOY_PATH/conf/$REGULAR_TASK_NAME > $DEPLOY_PATH/logs/submit.log &
+flink run -d -c com.zorkdata.desensitization.TransactionLogDesensitization $DEPLOY_PATH/lib/transaction-log-desensitization-0.1.jar --conf $DEPLOY_PATH/conf/$FLINK_TASK_CONF > $DEPLOY_PATH/logs/submit.log &
 
 sleep $DEFAULT_SLEEP_TIME
 

[sonarqube]

SonarQube analysis reported 180 issues

• ⛔ 2 blocker
• 🚫 24 critical
• ⚠ 131 major
• 🔽 20 minor
• ℹ 3 info

Top 30 extra issues

Note: The following issues were found on lines that were not modified in the commit. Because these issues can't be reported as line comments, they are summarized here:

1. ⛔ Remove this hard-coded password. 📘
2. ⛔ Remove this hard-coded password. 📘
3. 🚫 Define a constant instead of duplicating this literal " {\n" 11 times. 📘
4. 🚫 [Define a constant instead of duplicating this literal " "type": \n" 11 times. 📘
5. 🚫 Define a constant instead of duplicating this literal " "string",\n" 6 times. 📘
6. 🚫 Define a constant instead of duplicating this literal " "null"\n" 6 times. 📘
7. 🚫 [Define a constant instead of duplicating this literal " ]\n" 11 times.](https://git.zorkdata.com/liaomingtao/transaction-log-desensitization/blob/e390bb16d3d905de246c7a947b0e77376b8310da/src/main/java/com/zorkdata/desensitization/avro/AvroSchemaDef.java#L23) 📘
8. 🚫 Define a constant instead of duplicating this literal " },\n" 9 times. 📘
9. 🚫 Define a constant instead of duplicating this literal " "null",\n" 5 times. 📘
10. 🚫 Define a constant instead of duplicating this literal " {\n" 5 times. 📘
11. 🚫 Define a constant instead of duplicating this literal " "type": "map",\n" 5 times. 📘
12. 🚫 Define a constant instead of duplicating this literal " "values": "string"\n" 3 times. 📘
13. 🚫 Define a constant instead of duplicating this literal " }\n" 5 times. 📘
14. 🚫 Define a constant instead of duplicating this literal "序列化失败" 13 times. 📘
15. 🚫 Refactor this method to reduce its Cognitive Complexity from 22 to the 15 allowed. 📘
16. 🚫 Refactor this method to reduce its Cognitive Complexity from 98 to the 15 allowed. 📘
17. 🚫 Refactor this method to reduce its Cognitive Complexity from 22 to the 15 allowed. 📘
18. 🚫 Refactor this method to reduce its Cognitive Complexity from 22 to the 15 allowed. 📘
19. 🚫 Refactor this method to reduce its Cognitive Complexity from 19 to the 15 allowed. 📘
20. 🚫 Change this "try" to a try-with-resources. (sonar.java.source not set. Assuming 7 or greater.) 📘
21. 🚫 Refactor this code to not throw exceptions in finally blocks. 📘
22. 🚫 Refactor this code to not throw exceptions in finally blocks. 📘
23. 🚫 Change this "try" to a try-with-resources. (sonar.java.source not set. Assuming 7 or greater.) 📘
24. 🚫 Define a constant instead of duplicating this literal "jobName" 4 times. 📘
25. 🚫 Define a constant instead of duplicating this literal "2020-11-07 21:22:20" 4 times. 📘
26. 🚫 Define a constant instead of duplicating this literal "2020-11-07 23:40:30" 4 times. 📘
27. ⚠ Remove this commented out code. 📘
28. ⚠ Rename "jsonObject" which hides the field declared at line 39. 📘
29. ⚠ Remove this expression which always evaluates to "true" 📘
30. ⚠ Remove this expression which always evaluates to "true" 📘

• ... 150 more