First, make sure to register for Google Search Console, Bing Webmaster Tools, and Yandex Webmaster as the domain admin. There are some other search engine portals such as Baidu and Petal which might be worthwhile adding... but certainly not necessary. Also note that if you live outside of the Great Firewall of China, you might have difficulty signing up.
Google obviously is the largest search engine, While Bing is trailing, they also operate the backend for the Yahoo search engine... and it's managed in their same portal. Yandex is popular in Eastern Europe, while I have heard that DuckDuckGo uses Yandex and Bing as partners.. so getting your site on those webmaster portals won't hurt. Brave Search currently isn't letting webmasters submit links...
Each site will require some form of confirmation that you do in fact own the domain name. Sometimes, they want you to add a DNS entry, add a meta tag to your html page, or upload a file to your domain with a long string of text...
I prefer usually via the meta html tag or DNS record. Note that some of these cover the whole domain and others just count for the subdomain and even the current page. I know that google will remove your site form the console if you remove the verification method after being approved.
Once you confirm ownership, make sure to get your sitemap file recognized. You should make it in your main directory like this: example.com/sitemap.xml. Then on each webmaster portal, there will be a section to link to your sitemap. If you use blogger, they have some special sitemaps which are generally accepted too (as well as RSS Feeds):
example.com/atom.xml?redirect=false&start-index=1&max-results=500
If your site is static, and you don't want to have to manually add links to your sitemap... there are a few actions on github which might do the job such as this.
Next, check your robots.txt file (should be in your main directory - example.com/robots.txt) and make sure it's not going to block the indexing bots from webpages or directories you want to appear in search results. You can also reference your sitemap here! If you do not have a robots.txt file, now is the time to create one.
Don't forget to add this to the end with your domain and sitemap link (everything in bold):
Sitemap: https://www.example.com/sitemap.xml
This allows the search engine web-crawlers easy access to your important pages!
If you use images, make sure to add a descriptive alt tag which helps for both accessibility and SEO!
Backlinks are also super important, it tells these search engines that your site is useful and reputable. Make sure to get your link on other sites legitimately, maybe by offering to guest post or if you have a profile... there might be a field to let you link to your site etc.
For starters, try submitting your relevant links to subreddits, hackernews, indiehackers, pinterest boards, etc.
Thank you for reading, please share the article and follow me on twitter for more resources and guides!
This was a great article! - question: what about robots.txt? they don't get indexed. is that important?
ReplyDeleteThanks! Robots.txt does get crawled and noticed by search engine bots... It's incredibly important as if you block some directory, the good bots won't even index pages in that directory... it's also a good place to write where your sitemap is located ... as robots.txt is the first page which these bots look at - and it helps them locate your sitemap for what they do index!
Delete