best way to set up a MySQL database for storing web data

I will be using curl to retrieve thousands of adult websites. My goal is to store them in MySQL to allow users to easily search the new database and find their desired page without having to endure all the popups, spyware, etc.

It will be an adult website s开发者_运维问答earch engine... kinda the google of adult websites, but without the malware sites that find their way onto google from time to time.

At first run I downloaded about 700K lines at about 20 GB of data. Initially I stored all info in a single table with columns for URL, HTML PAGE CODE, PAGE WITH NO HTML TAGS, KEY WORDS, TITLE and a couple more.

I use a MATCH AGAINST query to search for the users desired page within TITLE, KEY WORDS, PAGE WITH NO HTML in any variety of combinations or singularly.

My question is... would I be better off to break all these columns into separate tables and would this improve the speed of the searches enough that it would matter?

Is there any advantage to storing all the data in multiple tables and then using JOIN's to pull the data out?

I am just wondering if I need to be proactive and thinking about high user search loads.

MySQL isn't good with full-text search and never was.

Look into Sphinx or Lucene/Solr, they're the best fit for the job. I'd suggest sticking to the former.