Keep search engine bots off mydomain.com:8000 ?

micko_escalade · 21st March 2006, 14:03

Hi all!

I know you can define in robots.txt to which folders on server bots have access to, but I'm not sure how to keep them off port ie. 8000

the reason why I'm asking is cause I have current song turned on in DNAS and I also have now playing signature on my webpage so I don't want search engines to index all songs that get played and other people can find it and listen to it, I just want my site visitors to be able to listen.

any help is appreciated

angst · 21st March 2006, 16:15

umm, incase you didn't know. the more dynamic content you have on your site, and more listings you will get on search engines. THIS IS A GOOD THING! someone searching for a song that was playing, for example, last week on your station, might endup there and decide to listen to your station, being as it had played atleast one song that they liked.

anyway, search engines are your friend. if you really don't want to be on them, then don't make your site public.

-SiX

micko_escalade · 21st March 2006, 16:35

Thanks angst for the reply!

Well in my case I wanna keep just for the members of my home city web site, and also I have to watch on bandwith as well, that's why I was asking if there's any way around it.

angst · 21st March 2006, 16:38

hmm,
well. thats a tough one. only people that live in your city...

I'll think about that and post back after.

-SiX

micko_escalade · 21st March 2006, 17:42

Let me add that most of them live now around the world.

hackerdork · 22nd March 2006, 02:53

Most search engines only use port 80 and not 8000. Robots.txt wouldnt do any good since the DNAs doesnt use apache

~ DK

angst · 22nd March 2006, 12:12

not nessesarly true, search engines start on port 80, but will follow links on the site to other ports if any exist.

hackerdork · 22nd March 2006, 18:18

well all the years that shoutcast has been running and all the fancy signatures when I google search or other engines I dont get hits back to the radio station links.. So the google bot never looked at the radio station/PLS

~ DK

angst · 22nd March 2006, 18:46

no, I'm not sure that they would fallow a .pls file.
but I know that I have a dev version of on site running on port 90 last year, and some body posted a link to it in our forum, and before i could remove it, good has fallowed the link, ended up having to move the site to a new port after that.

21st March 2006, 14:03	#1
micko_escalade Junior Member Join Date: Aug 2004 Posts: 18	Keep search engine bots off mydomain.com:8000 ? Hi all! I know you can define in robots.txt to which folders on server bots have access to, but I'm not sure how to keep them off port ie. 8000 the reason why I'm asking is cause I have current song turned on in DNAS and I also have now playing signature on my webpage so I don't want search engines to index all songs that get played and other people can find it and listen to it, I just want my site visitors to be able to listen. any help is appreciated

21st March 2006, 16:15	#2
angst Major Dude Join Date: Dec 2000 Location: Toronto, Canada! Posts: 545	umm, incase you didn't know. the more dynamic content you have on your site, and more listings you will get on search engines. THIS IS A GOOD THING! someone searching for a song that was playing, for example, last week on your station, might endup there and decide to listen to your station, being as it had played atleast one song that they liked. anyway, search engines are your friend. if you really don't want to be on them, then don't make your site public. -SiX SiX - what's reality compared to me... www.remixwars.com - free mp3's for download! free shoutcast scripts: http://dev.irn.ca

21st March 2006, 16:38	#4
angst Major Dude Join Date: Dec 2000 Location: Toronto, Canada! Posts: 545	hmm, well. thats a tough one. only people that live in your city... I'll think about that and post back after. -SiX SiX - what's reality compared to me... www.remixwars.com - free mp3's for download! free shoutcast scripts: http://dev.irn.ca

22nd March 2006, 02:53	#6
hackerdork Forum King Join Date: Feb 2006 Location: Earth Circa sometime. Posts: 3,297	Most search engines only use port 80 and not 8000. Robots.txt wouldnt do any good since the DNAs doesnt use apache ~ DK ~ According to the ship's log we're down to our last 3000 vomit bags.It'll never be enough. search the forums! don't PM me on how-to, or ask me to setup you system. you do it so you learn.

22nd March 2006, 12:12	#7
angst Major Dude Join Date: Dec 2000 Location: Toronto, Canada! Posts: 545	not nessesarly true, search engines start on port 80, but will follow links on the site to other ports if any exist. SiX - what's reality compared to me... www.remixwars.com - free mp3's for download! free shoutcast scripts: http://dev.irn.ca

21st March 2006, 16:35	#3
micko_escalade Junior Member Join Date: Aug 2004 Posts: 18	Thanks angst for the reply! Well in my case I wanna keep just for the members of my home city web site, and also I have to watch on bandwith as well, that's why I was asking if there's any way around it.

21st March 2006, 17:42	#5
micko_escalade Junior Member Join Date: Aug 2004 Posts: 18	Let me add that most of them live now around the world.

22nd March 2006, 18:18	#8
hackerdork Forum King Join Date: Feb 2006 Location: Earth Circa sometime. Posts: 3,297	well all the years that shoutcast has been running and all the fancy signatures when I google search or other engines I dont get hits back to the radio station links.. So the google bot never looked at the radio station/PLS ~ DK ~ According to the ship's log we're down to our last 3000 vomit bags.It'll never be enough. search the forums! don't PM me on how-to, or ask me to setup you system. you do it so you learn.

22nd March 2006, 18:46	#9
angst Major Dude Join Date: Dec 2000 Location: Toronto, Canada! Posts: 545	no, I'm not sure that they would fallow a .pls file. but I know that I have a dev version of on site running on port 90 last year, and some body posted a link to it in our forum, and before i could remove it, good has fallowed the link, ended up having to move the site to a new port after that. SiX - what's reality compared to me... www.remixwars.com - free mp3's for download! free shoutcast scripts: http://dev.irn.ca

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode