adding ASP pages to search engines and directories.
What would be the best way to add pages from a mainly ASP website to the major search engines?
I heard that .asp pages are not really indexed etc. or that there is another way to do it effectively.
This is for some help regarding a website that is mainly asp. pages. and is a news website. News articles are added daily from a separate part of the site, and are stored in an "access" database, i think it's SQL
Even the home page is an index.asp page. I can't really use static pages on these , pages, as i have to show included content from the database, and the pages that show the articls have the asp look to it, ie. there is a question mark in the url.
What is the best way for me to add this to google, altavisa etc?
I also note that a lot of my pages have an inc. header page which means that they all also have the same title.
Ideally i'd like each news article to have a separate title, but if not, i'd like each page to be indexed .
Could someone please advise. Many thanks in advance.
All you really need to do is to research on google for submitting urls. I believe that google has a page where you can submit your url alongside comments which is regarded as your keywords.
Who ever told you that Index.asp or asp pages are not crawled lied to you.
Just don't forget to include keywords meta tag for yahoo and msn etc. and submit your url to google via their url submission page. (That I believe you have to perform a couple of times a week until your site is finally indexed in their databases)
I'm aware that you can submit asp pages, however, my point was that the search engines don't like dynamic pages, and i'd like google to be able to add my news to their news sections daily.
I've heard they don't bother with dynamic pages, and you have to make them html or take out the ? out of the url's.
I'm aware i can submit to the search engines, but i don't just want to submit, i want to be able to market it like an html site,
Karen,
I have had dynamic pages all the time and have had no problem with search engines. The key to this is dynamically setting your keywords in the meta tags.
I have always called my keyword tags dynamically e.g. <meta name="keywords" content="<%= rs("keyword")%>, that way, when you are creating a dynamic page, you can insert a keyword field together with it in the table in which you store the text.
I have had good luck with the search engines being that when I do a search, the dynamic pages do come up. Most crawlers follow links on the main page and wrap around the entire web site so once again, your dynamic page can be found even if you don't want to submit the site to Google etc.
When someone goes to the homepage above, they will see a header logo with links, and the main page split up into 3 columns. The first 2 columns are coded under the index.asp page, and they have "include files" to make them look like this
The index.asp has a header file that includes the header menu,logo, links , javascript and the meta tags.
Column 1
This contains the "inc. news" file and has 10 links which lead to a full page view of the news story.
Column 2 this is the same as Col 1 but op-eds are filtered here
column 33rd column which has links like search and news polls
The inc.footer file calls up the 3rd column and the footer menu with links at the bottom of the page.
The news stories are actually added to a database, thus don't really have thier own page if you know what i mean. They are called up from previously coded links on various asp pages in the website, as in the columns above.
My problem is i want to submit each news page story to google news so that it's daily news contains my news stories too. THis means each page will have to have it's own unique meta tags. Currently the inc.header.asp includes the meta tags which obviously will be the same on every page called up.
I don't know anything about html or coding or asp. Most of the news pages have to be asp pages.
The only solution i can see, is to keep a separate page in my website which has physical links to the news stories. When google comes to crawl, google will crawl all these links. Will this work? it seems like a tedious addition to my daily updates on the news weblog.
also how would you add the words in the meta tags below,? would they be separated by a comma or what ? like this forexample?
<meta name="Keywords" content="<%=this, is, some, keywords,%>"<meta>
Code:
<!--#include file="config.asp"-->
<!--#include file="inc_api.asp"-->
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<title><%=title%></title>
<meta name="Description" content="<%=meta_description%>"<meta>
<meta name="Keywords" content="<%=meta_keywords%>"<meta>
Now that I understand what exactly you are trying to do.
Correct me if I am wrong though.
You have the main page (home page) which includes the links to the news items by ID, i.e. http://mywebsite.com/News.asp?CID=108 where content ID number 108 is the particular news item in question.
I suppose also that you want each news item to have its own keywords right?
If that is what you want then please follow these steps.
Create an extra column in your table that holds the news contents and name it keyword or something like that and make sure to use memo if you are using Access or either varchar (500) or something close.
On your news entry page, create a text box or text and map it to the field in the dataset.
That way, each news item will have its own keywords, title etc... CID 108 can have keywords of “this is what, I meant, to do.” I have attached a screen shot of what I was trying to convey.
So on http://mywebsite.com/News.asp , you will have
Call your recordset and assign the values accordingly as given below.
<title><% rs(“title”)%></title>
<meta name="Keywords" content="<%= rs(“keyword”)%>" />
Finally, when http://mywebsite.com/News.asp?CID=108 is called, it will display its own title on top of the page as well as the keywords. This will make it easier for link sweeping.
If you need extra help on this, I will be more than willing to help out.
Emefa, someone told me that the solution below may solve my problem. It puts the meta tags in the inc.header.asp and the variables in the news page itself. I can then add these variables as code when i add the news items in the database? I don't need to do all what you described above now do i? ie. create a new table?
It's a nuisance. All i want is for google news to pick up my news pages each day. I hope the solution below is suitable? It was given by a professional but i havn't tested it yet. Thank you for your other message. Much appreciated.
inc.header.asp
Code:
<!--#include file="config.asp"-->
<!--#include file="inc_api.asp"-->
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<title><%=title%></title>
<meta name="Description" content="<%=meta_description%>"<meta>
<meta name="Keywords" content="<%=meta_keywords%>"<meta>
<link rel="STYLESHEET" type="text/css" href="styles.css">
<STYLE TYPE="text/css">
<!--
body {scrollbar-base-color: #4139E1}
-->
</STYLE>
<script src="java.js" type="text/javascript"></script>
all other javascript code
</head>
<body
leftmargin="0" topmargin="0" marginwidth="0" marginheight="0">
<table width="750" border="0" cellspacing="0" cellpadding="2" align="center">
<tr>
<td valign="top" class="style12">
<TABLE WIDTH=750 BORDER=0 CELLPADDING=0 CELLSPACING=0 align="center">
<TR>
<body bgcolor="#FFFTYU">
<center>
<TD colspan="2" align="center">
Header links menu go in here. A set of links here which show on every page at the top. </TD>
</TR>
</TABLE>
Yes Karen,
The last solution will work fine.
Just don't forget to Dim
Code:
<%
Dim title,meta_description,meta_keywords
title = "Welcome to Widget World"
meta_description = "We sell more widgets than anybody else"
meta_keywords = "widget, foo, bar, banana daquiri, fruit loops"
%>
You are on the right track.
The interesting thing is that, there are several ways of doing things.
Don't you just love programming the web?
Good luck.
Thank you, the person who gave me that code said this:
In theory, you should *always* use a DIM of every variable.
In practice, unless you coded
<% OPTION EXPLICIT %>
as the first line of your VBS/ASP code, it doesn't make a difference.
Just so as you know.
thank you for all your tips. One final question. Does this mean that each time i want to submit to google news (which will be daily as it's daily news) should i click the dynamic url or the home page of the site?
Obviously if Google crawls the home page, it will only find the code to the URL not the URL itself.
I'm curious, I wonder do people try this method as a way around it. Keep a separate page on the website with every dynalic url actually listed? it seems like a tedious job.
In theory, the home page of my website has 10 links with "previous next" added, so that people can go back. What i want to know is does the google crawler actually follow the previous next links? if so, and it can read, then it won't be necessary to keep a separate page with static urls of the dynamic pages.
Karen,
On the homepage, again in the meta tag, add this
Code:
<meta name="robots" content="index,follow">
This will allow for two things, a crawler can index the home page and follow every single link on the home page. That way, when you have your next >> and previous links, the crawlers will follow each link and you don't have to do any hard work after that.
Karen,
On the homepage, again in the meta tag, add this
Code:
<meta name="robots" content="index,follow">
This will allow for two things, a crawler can index the home page and follow every single link on the home page. That way, when you have your next >> and previous links, the crawlers will follow each link and you don't have to do any hard work after that.
do you mean like this (1)
Code:
<%
title = "Welcome to Widget World"
meta_description = "We sell more widgets than anybody else"
meta_keywords = "widget, foo, bar, banana daquiri, fruit loops"
meta name="robots" content="index,follow"
%>
<!--#include file="inc_header.asp"-->
or this (2)
[CODE]
Code:
<%
title = "Welcome to Widget World"
meta_description = "We sell more widgets than anybody else"
meta_keywords = "widget, foo, bar, banana daquiri, fruit loops"
meta name="robots" content="index,follow"
%>
<!--#include file="inc_header.asp"-->
<meta name="robots" content="index,follow">
and do i have to add anything to the inc.header.asp too? here is the relevant part of the inc.header.asp
Code:
<!--#include file="config.asp"-->
<!--#include file="inc_api.asp"-->
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<title><%=title%></title>
<meta name="Description" content="<%=meta_description%>"<meta>
<meta name="Keywords" content="<%=meta_keywords%>"<meta>
<link rel="STYLESHEET" type="text/css" href="styles.css">
<STYLE TYPE="text/css">
Bookmarks