After spending some time on searching on Google and reading some WooCommerce forums I found out that it was much easier than expected.
Do not use quotes or %2C.
Just escape the comma using a backslash like \,
That’s all! It will work like a charm. I had to replace all commas to \, on my product catalog on Airtable.