Page 1 of 3 123 LastLast
Results 1 to 25 of 64
  1. #1
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    Honiara, Solomon Islands
    Posts
    1,085
    I am getting invalid requests from this spider as it has the nasty habit of changing all url requests to lower case.

    I am of the opinion that this spider has something to do with policing the validity of sales by checking the existance of the link on the page.

    If this is the case all my pages are returning 404 errors to the spider as the spider is asking for the WRONG URL.

    Please clarify this CJ as I am worried that I am in some way getting penalised due to an error in the setup of your spider.

    Thanks, DPG

  2. #2
    ABW Ambassador Mike O's Avatar
    Join Date
    January 18th, 2005
    Location
    Los Angeles area
    Posts
    843
    I'm seeing the CJ Spider doing wrong stuff too.

    In my case I have a URL of the type "...\name1_name2" and it keeps trying to just find "...\name1". It's as if it stopped logging the URL when it hit the underscore.

    It just hits the wrong URL over and over, getting 404 every time, for 60 times in a row...

    -- Mike

  3. #3
    Resident Genius and Staunch Capitalist Leader's Avatar
    Join Date
    January 18th, 2005
    Location
    Florida
    Posts
    12,817
    More commentary about the CJ Spider is here:

    http://abw.infopop.cc/6/ubb.x?a=tpc&...9&m=2236058992

    And yeah, it keeps messing up the URL requests!

    -I've been a king, and I've been a pauper, and everything there is in between ~T.G. Sheppard. NOT Frank Sinatra!

  4. #4
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    2,419
    I'm seeing way to many "basic errors" from this thing and I can't believe that any knowledgable person or group would be so dumb to even be running it with these kinds of problems.

    This leads me to only one conclusion and it's not a positive one.

  5. #5
    ABW Ambassador Andy's Avatar
    Join Date
    January 18th, 2005
    Posts
    4,178
    If this is indeed spawned by CJ, it seems to be typical of them. Roll it out, cross your fingers, and hope it works properly.

    And it never does...

    Andy

    MERCHANTS! Ask yourselves: "What's in my affiliate program that makes it worthwhile to publishers?" Hint: if you have one day cookies, or if the cookie is deleted after the first sale, or if you reverse legitimate transactions, you have nothing to offer.

  6. #6
    Full Member
    Join Date
    January 18th, 2005
    Posts
    442
    Haha, I thought I am only the one. It must be a windows spider which though case in URL are not CaSE SeNSiTiVE!

  7. #7
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    796
    This is a very bad spider ... the work of an amateur.

    On WMW people are already talking about banning it as a rogue spider.

    Using a spider for some sort of compliance checking may be a good idea but CJ better put this one in the hands of someone that knows what they're doing. They're opening a can of worms.

    Are our sales being trashed because this mindless spider can't find or recognize our pages ????

    Please, Todd, fess up!

  8. #8
    Full Member
    Join Date
    January 18th, 2005
    Posts
    442
    If the spider is to check if a tracking link appear, then it is just too dump because in large site like mine, I use a script to redirect them the the correct advertiser. How can the spider see it from the HTML code?!

  9. #9
    Ad Network Rep ToddCrawford's Avatar
    Join Date
    January 18th, 2005
    Location
    Santa Barbara, CA
    Posts
    2,162
    We are testing a new product and it apparently had too high of a setting and may have made too many requests for some servers to handle. If this caused any problems, we apologize. The spider has been reconfigured to not cause these problems. We have also corrected some of the other issues mentioned above.

    So, what is this spider? Nothing to worry about. Once the product is released, we'll tell you more (July?). Suffice it to say it will help ensure the quality of our network and enable us to create and manage more productive relationships.

    Todd Crawford
    Commission Junction

  10. #10
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    1,087
    quote:
    So, what is this spider? Nothing to worry about. Once the product is released, we'll tell you more (July?). Suffice it to say it will help ensure the quality of our network and enable us to create and manage more productive relationships.
    Not unlike the typical quality of the upgrades thus far I'm sure . . .

    Brian
    aka Cyclone

    Get while the getting's good

  11. #11
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    North Carolina
    Posts
    1,026
    Todd,

    What happens if an affiliate bans this spider before knowing any more details (pre-July)?

  12. #12
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    North Carolina
    Posts
    1,026
    quote:
    Originally posted by Whiznot:
    This is a very bad spider ... the work of an amateur.


    Ditto. Does not even read robots.txt properly.

  13. #13
    ABW Ambassador Andy's Avatar
    Join Date
    January 18th, 2005
    Posts
    4,178
    KCEdit wrote:
    quote:
    What happens if an affiliate bans this spider before knowing any more details (pre-July)?
    From what I've read, that's just what a lot of people are doing.

    Andy

    MERCHANTS! Ask yourselves: "What's in my affiliate program that makes it worthwhile to publishers?" Hint: if you have one day cookies, or if the cookie is deleted after the first sale, or if you reverse legitimate transactions, you have nothing to offer.

  14. #14
    ABW Ambassador buy_online's Avatar
    Join Date
    January 18th, 2005
    Location
    Richmond, VA
    Posts
    3,234
    "What happens if an affiliate bans this spider before knowing any more details (pre-July)?"

    This is a super important question, which could be said another way - "Will affiliates be penalized or seen in a negative way if they prevent the CJ spider from accessing our sites?"

    Fred

    "Those who deny freedom to others, deserve it not for themselves; and, under a just God, can not long retain it." Abraham Lincoln

  15. #15
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    4,423
    Todd, we are partners with you, not employees. To use our resources without explaining is unforgivable.

    We are all members of many networks and programs. We cannot take the weight of all them spidering for their gains. Amazon already does this, now CJ?

    This is like spam, each spammer thinks he is unique, and what is one little old mail. It is the combined weight that is part of the issue.

    The other part is trust. I am not beholden to CJ. If you want to improve our relationship I suggest you ask and explain before you make the first move, don't just try and slip me a mickie and tell me it is good for me.

    Chet

  16. #16
    ABW Ambassador ShoreMark's Avatar
    Join Date
    January 18th, 2005
    Location
    NJ, USA
    Posts
    912
    quote:
    Originally posted by Chez Noir:
    Todd, we are partners with you, not employees. To use our resources without explaining is unforgivable.

    We are all members of many networks and programs. We cannot take the weight of all them spidering for their gains. Amazon already does this, now CJ?
    From what I gather the Amazon spider ignores robots.txt and CJ probably will too? You're absolutely right, if every relationship we enter into suddenly starts spidering the site for whatever good reason they think of (for them), we end up being moved into a higher bandwidth plan and losing money before a sale is even made. Rather than waste our resources spidering our sites, CJ would be better advised to spider the merchants product links and feeds to see if they are providing accurate links - why look for bad ones on hundreds of thousands of publishers sites vs. hundreds of merchant sites?

  17. #17
    Member
    Join Date
    January 18th, 2005
    Posts
    103
    quote:

    So, what is this spider? Nothing to worry about.



    Hmmm ... I'm suffering adverse reactions.


    "What's in the box?"

  18. #18
    ABW Ambassador Andy's Avatar
    Join Date
    January 18th, 2005
    Posts
    4,178
    FAMOUS LAST WORDS
    quote:
    So, what is this spider? Nothing to worry about.
    That ranks right up there with:


    "Mrs. Lincoln, you're really going to enjoy the play!"

    "The weather's so nice in Dallas, we've put the top down on the Limousine..."

    "Terrorists will never attack Americans on American soil..."



    It think I'll feel better if I start worrying about it now...

    Andy

    MERCHANTS! Ask yourselves: "What's in my affiliate program that makes it worthwhile to publishers?" Hint: if you have one day cookies, or if the cookie is deleted after the first sale, or if you reverse legitimate transactions, you have nothing to offer.

  19. #19
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    Nunya, Business
    Posts
    23,684

  20. #20
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    Nunya, Business
    Posts
    23,684
    "So, what is this spider? Nothing to worry about. Once the product is released, we'll tell you more (July?). "

    Todd, why so secretive? Maybe you should actually try communicating and listening to affilites. Telling us not to worry about it, we'll let you know in July is BS. That bot you sent out, from what i heard, has caused database sites to go down from memory allocation errors, crashed servers, eating up bandwidth, etc. We have a right to know, not telling us causes distrust, doing this you can't be a "trusted third party"

    It seems CJ has gotten very cocky, to the point that you're going to do whatever you want and do what you think is best for us, even tho we might disagree with it. A good idea would be to start communicating better, any distrust or sh1t you catch is because of your failure to do this.

    "Nothing focuses the mind better than the constant sight of a competitor who wants to wipe you off the map."
    --Wayne Calloway

  21. #21
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    796
    Todd, some of us have had so much bandwidth sucked up by unwelcome spiders we've configured our sites to only allow listed spiders, like from certain search engines. If the CJ spider isn't on the welcome list, it isn't going to get in without hacking it's way in.

    Also, I'm sure many of us have installed our affiliate links in external javascript files for easy maintenance, and gone one step further to robot-excluded those files specifically to put up a firewall against spiders. I know of no spider on the face of the earth that can find links placed in robot-excluded external javascript files.

    The CJ bot may spider the Geocities crowd's sites at will, but it's going to get it's butt kicked when it strays into some of mine. Sorry, no offense to CJ, I had no idea they would ever want to spider my sites.

    CJ ought to consult with their partners before visiting us with a rogue spider. A little consultation will save them from embarrasment and man-years of wasted programming efforts, to say nothing of the ill will this kind of activity can generate.

  22. #22
    Full Member
    Join Date
    January 18th, 2005
    Posts
    442
    Huh, what todd says really make me nervous.

    I don't feel good on it. Let's come back to the root. They need to spider to get a page, to get a page where your have refered your visitor to your merchant.

    Waht if they can't find the appropriate link, they doesn't record your transaction!

    Problems - No 1x1 pixel? No real code like me (redirect script)? ...

    DEEP IMPACT ... I am sure it would be the worst thing that can happened. If we really no need to worry about it, why we need to wait until July to find it out!

  23. #23
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    2,419
    I never figured this spider was atually from CJ. Lets see it's so stupid it doesn't even regognize an _ in a file name which causes an error.

    CJ knows which merchants I deal with from their network and further even knows the links I use from them.... So why in the world would they need to write some half ass program to come spider my site and what frinking benefit will it provide me?

    "nothing to worry about" Ha.......

    I don't mind saying this action and definately the response does nothing to instill "trust" in CJ nor the reliablity of it's services. This seems like a very bad joke and makes me want to join the "I DEMAND" revolution for a more qualified response on the prupose of this spider.

  24. #24
    Member
    Join Date
    January 18th, 2005
    Posts
    154
    ShoreMark,

    You said
    ----------------------------------------
    "Rather than waste our resources spidering our sites, CJ would be better advised to spider the merchants product links and feeds to see if they are providing accurate links - why look for bad ones on hundreds of thousands of publishers sites vs. hundreds of merchant sites?"
    ------------------------------------------

    Excellent!....... VERY Excellent!!!

    Case Over!!

    If we don't get some kool rules ourselves...... pronto........ then we'll just be bogus too.. ~Jeff Spicoli~

  25. #25
    I like traffic lights
    Join Date
    January 18th, 2005
    Location
    Southern hemisphere - away from Fukushima
    Posts
    2,936
    Maybe they're looking for affiliates running banners on banner networks?

    Or maybe searching for "inappropriate" keywords on pages that have CJ links on them?

    Jimmy James Inc. fan club membership # 3312

+ Reply to Thread
Page 1 of 3 123 LastLast

Similar Threads

  1. good spider or bad spider?
    By Gordon in forum Newbie Affiliate FAQs & Helpful Articles
    Replies: 3
    Last Post: September 3rd, 2004, 09:38 AM
  2. New spider?
    By womanht in forum Midnight Cafe'
    Replies: 1
    Last Post: August 8th, 2004, 06:00 AM
  3. CJ Spider?
    By appbizz in forum Midnight Cafe'
    Replies: 1
    Last Post: April 7th, 2003, 10:12 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •