getting rid of search_index table

We're in the processing of adding solr searching to our CMS. After this is finished, would it be ok to get rid of the data in the search_index table (by tuncating it)?

I ask because the table has close to 10 million rows in it and makes rolling back database a big pain.

I'm assuming if we are using a 3rd party system for searching then we dont need that table but i'm seeing conflicting opionions when i google around.

Thanks
Dan