WebWorkers and Queues

Im just getting started with Queues, and they work fine for messaging and sending emails and SMS's to Twilio etc.

But now I want to do something more complex, and time consuming. I'm looking to upload a file of about 10,000 rows to AmazonS3, parse it, check for duplicates, and then only insert records that aren't duplicates.

When I run this process it takes over 6 minutes to complete. Which is way to long. I want to have this run in the background, with a visual progress bar that gets updated sporadically, based on the queue status.

Also, while this is running, I want the users to have full access to the site and database tables. This process, will lock my main table.
So I basically want to have it run in the background, check the main table for duplicates, and then obviously create a temporary table of 10,000+ rows. While leaving the other table free. Then only write once to the main table quickly.

How can I achieve this without slowing the site/main server down?? I apologize for the extremely broad question