How to stop 403 and 404 http errors from facebook bots and/or refresh share cache -

-


How to stop 403 and 404 http errors from facebook bots and/or refresh share cache -

i'm getting lots of 403 , 404 errors facebook bots after changing directory construction on server few weeks ago. of course, such errors should expected in situation until cache clears, , has happened in cases. however, i'm still getting error select grouping of share links. i've tried repeatedly clear cache through debug tool corresponding pages, , looks perfect in output, bad requests maintain coming. (lint tool: lint tool url). here examples logs:

http access log:

69.171.224.251 - - 443 [13/jan/2012:06:22:01 -0500] "get /web/user/images/b0/b0ahhsjq1c1oex0tbs5glamcsx4wkdpt.240.jpg http/1.1" 403 338

and http error log:

[fri jan 13 05:55:01 2012] [error] [client 69.171.228.249] file not exist: /var/xxx/www/html/web/user/images/1/ab/absiktlhds3rcupyyftxsp8j9u7vvavr.240.jpg

these ip addresses point facebook.

perhaps linting wrong url? how can find out url these requests belong to? doesn't facebook stop requesting after point , refresh cache? sec error above repeated 25 times day lastly week.

(at point not consider url rewriting.)

you should set 301 permanent redirects. or sort of url rewriting. either way works.

you can sure reports filter out user agent linter/scraper

when facebook scrape page?

facebook needs scrape page know how display around site.

facebook scrapes page every 24 hours ensure properties date. page scraped when admin open graph page clicks button , when url entered facebook url linter. facebook observes cache headers on urls - @ "expires" , "cache-control" in order of preference. however, if specify longer time, facebook scrape page every 24 hours.

the user agent of scraper is: "facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)"

facebook share bots http-error

Comments

Post a Comment

Popular posts from this blog

How do I check if an insert was successful with MySQLdb in Python? -

-
How do I check if an insert was successful with MySQLdb in Python? - i have code: cursor = conn.cursor() cursor.execute(("insert new_files (videos_id, filename, " "is_processing) values (%s,%s,1)"), (id, filename)) logging.warn("%d", cursor.rowcount) if (cursor.rowcount == 1): logging.info("inserted values %d, %s", id, filename) else: logging.warn("failed insert values %d, %s", id, filename) cursor.close() fun is, cursor.rowcount always one, though updated database create videos_id unique key. is, insert fails because in tests same videos_id going appear (and when check database, nil inserted). whatever reason, rowcount 1 - logging.warn have spits out rowcount of 1. so, question: can utilize rowcount work out if insert went fine? if so, (presumably) doing wrong? otherwise, how check if insert went fine? your code not commit after modifications (your modifications rolled back). should...
Read more

delphi - blogger via idHTTP : error 400 bad request -

-
delphi - blogger via idHTTP : error 400 bad request - i'm trying post blogger using idhttp component, however, i'm getting "http/1.0 400 bad request" error. procedure tform1.button1click(sender: tobject); var request,response,req : tstringlist; auth,blogid : string; begin blogid := '00000000000000000000000'; request := tstringlist.create; response := tstringlist.create; req := tstringlist.create; idhttp1.request.connection := 'keep-alive'; idhttp1.request.contenttype := 'application/x-www-form-urlencoded'; idssliohandlersocket1.ssloptions.method := sslvsslv23; request.clear(); request.values['accounttype'] := 'google'; request.values['email'] := 'xxx@gmail.com'; request.values['passwd'] := 'yyy'; request.values['service'] := 'blogger'; response.text :=idhttp1.post('https://www.google.com/accounts/clientlogin',request); auth := resp...
Read more

postgresql - ERROR: operator is not unique: unknown + unknown -

-
postgresql - ERROR: operator is not unique: unknown + unknown - i have postgis database , have compute new values rows in new column. these values should average of values of several columns. query: insert bdps (da_m) values (avg('da_1'+'da_2'+'da_3'+'da_4'+'da_5'+'da_6'+'da_7')); in query bdps database, da_m new column , da_1 da_7 existing columns have double precision type. da_m created using alter table bdps add together column da_m double precision; i next error: error: operator not unique: unknown + unknown line 2: values (avg('da_1'+'da_2'+'da_3'+'da_4'+'da_5'+'da_6'+'da_7... ^ hint: not take best candidate operator. might need add together explicit type casts. ********** error ********** error: operator not unique: unknown + unknown sql state: 42725 hint: not take best candidate operator. might need add togethe...
Read more