Improving Audience Growth in CM360 for Better DV360 Campaigns

Hello, We are currently using floodlights in CM360 to create retargeting via GTM, and then sharing the audience with DV360. However, we've noticed that our audience list is growing very slowly compared to the number of impressions our floodlight is detecting. Is there a way to accelerate this process? Additionally, does the slow audience list growth impact our target audience when running campaigns? I'm fairly new to this, and I seem to have gotten a bit lost.