I have two delimited set files, let’s call them “known_scores” and “possible_scores”, and these files are in the same format. The format is two columns with “ID” and “Score” as the columns. I want to combine the two files into one file such that if a common ID is found in both then we only keep the record from the “known_scores” file. I also want the “possible_scores” records kept if their IDs are not found in the “known_scores” file.
In this case, you can use join transformation with the option of left or right join which will bring you the records according to the join you have used. And then you can use filter transformation to only get records from “possible_scores” which are not in “known_scores” in your output.