1 exposed filter controlling 2 displays

I haven't been able to find a similar issue, but I may be trying to stretch this too far.

What I have is one view with two displays (w/ exposed filters) - one is a Table and the other a Gmap. I have them both shown on a Panel page so that "hopefully" whatever locations are filtered are also shown in the Table and on the Gmap.

The problem is that there are 2 exposed filters shown, and I would like 1 filter to control both of them.

Now to take it one step further: Once I have 1 filter to control the both - I will try placing the exposed filter in a block (on the frontpage)... which will then open the results in the Panel Page.

Anybody try this or have any ideas how to accomplish them? Like I said - it may not be possible and I may be trying to stretch it.