Gallery with Images and YouTube embeds possible?

I'm wondering if there is a way to create a gallery with images and youTube embeds together.

I've created a gallery by added a rel="x" to each link, and I can scroll through the images (well, the counts are wrong and images are duplicated - but that's a separate issue)...

But when I get to the embedded youtube, I lose the navigation controls and cannot move to the next item in the gallery.

I really love working with colorbox - it's been so easy to use and integrates great. I just don't know if I can use it for this gallery or not?

Thanks for your help!