INT483 Files Reprocessing Steps
INT483 is used to upload both Domestic & International price lists.
Before initiating the reprocessing, verify whether the file corresponds to Domestic or International
series. The reprocessing steps for both series are the same.
Follow the below for File Reprocessing-
Step1: Go to Storage Account -- aqaesbprd02euwdata01.
Step2: Click on containers and search INT486 and click on it.
Step3: Click folder path inbound/finance/PostResults and search for folder based on date (DDMMYY).
Step4: open the dated folder and click on folder named with ADF Main pipeline RunId
Step5: Inside folder search for Folder named as Retry and check files inside Retry folder.
Step6: After Retry folder search for Error folder and check files inside Error folder.
Step7: Open Storage Explorer installed in your VM and Connect to aqaesbprd02euwdata01 storage
account using connection string (to get connection string go to Azure Portal and search for storage
account ‘aqaesbprd02euwdata01’ and open it à in storage account à click on ‘Access keys’ tab à copy
connection string)
Step8: After connection is done expand blob containers and select int486 folder path à
inbound/finance/PostResults and search for folder named as date (example 070624) and press enter.
Step9: click on folder named as ADF pipeline Runid and you will be able to see ‘Retry’ and ‘Error’ folder
or you can search as well.
Step10: Open Retry and Error folder, check the count of files in both folders.
Step 11: Select all files in Retry folder and download all inside your Local (VM).
Step12: Select all files from Errors folder and download all files inside your local (VM).
Step13: if count of files in Error folder is more than count of files in Retry folder then compare file names
for both Error and Retry folder and find out that are not available in Retry folder.
Step14: Download files from archive folder which are not available in Retry folder but available in error
folder after comparing with Error folder.
Step15: for Example, in step 10 the count of files in error folder is 199 and count of files in retry folder is
also 199. Compare the names of files in both folders, if all the file names match, reprocess all the files
from Retry folder.
Note –
1. For a particular file, if it’s error file is not present but only retry file is present, then reprocess the
Retry file only.
2. For a particular file, if it’s error file is present but retry file is not present, then reprocess that
file’s original file from the Archive folder.
3. For a particular file, if both of it’s Retry and Error file is present, then Reprocess the Retry file
only.
Step16: For all files in Retry Folder create ‘.done’ files (steps to create .done files are mentioned in
‘create .done files’ document available on SharePoint link is given below)
Create_done_files.docx
Step17: After creating .done files open Azure portal and upload all files (json and .done) in
storage account aqaesbprd02euwnex01 and select fileshares/esb
Step18: click on esb and click on browse.
Step19: After Browsing select Nex/outbound/Finance/PostResults and upload all files.
Step20: After uploading files go to Azure Data Factory aqa-esb-prd-02-euw-fac-v2 and click on author
tab.
Step21: Select Pipelinesà ESBà INT486 and click on PM_00_486_Ingest_and Validate.
Step22: Click on Trigger and Trigger now and pipeline execution will start.