python 2.7 - Cannot update table , when comparing data between two cursors -

-

i wanted compare rows of table find out if equal or not , did create 2 cursors 1. select links table visted = yes 2. select links table visted = no using loop , if statement want compare visited links not visited links if equal or not , if equal update visted of link "yes" not done yet (my aim exit program if links visted , marked yes or cursor " visited=no " returns null value) portion code:

import sys import mysqldb import urllib import urlparse import re import htmlparser htmlparser import htmlparseerror bs4 import beautifulsoup      mydb = mysqldb.connect(host='localhost',     user='root',     passwd='shailang',     db='mydb')     cursor = mydb.cursor()      def process2(url):        flag=0        cursor.execute("select links data_urls visited = 'ye'")        yes_rows = cursor.fetchall()        cursor.execute("select links data_urls visited = 'no'")        no_rows = cursor.fetchall()        no_links in no_rows:          print 'noooooooooo'         k= no_links         print k         yes_links in yes_rows:             print "yessssssssssssss"                 k1 = yes_links             print k1                if k1 == k :                 print 'equals'                 cursor.execute("update data_urls set visited = 'ye' links = %s",k)             mydb.commit() def process(url):     proxies = {"http":"http://proxy4.nehu.ac.in:3128",         "https":"https://proxy4.nehu.ac.in:3128"}     page = urllib.urlopen(url,proxies=none)     text = page.read()     page.close()     soup = beautifulsoup(text)     file=open('s.txt','w')      cursor.execute("insert data_urls(links,parent,visited) values(%s,'null','ye')",url)     tag in soup.findall('a', href=true):     tag['href'] = urlparse.urljoin(url, tag['href'])         print tag['href']         if re.match(ur'(?i)\b((?:https?:\/\/|www\d{0,3}[.]|[a-z0-9.\-]+[.][a-z]{2,4}\/)(?:[^\s()<>]+|\(([^\s()<>]+|(\([^\s()<>]+\)))*\))+(?:\(([^\s()<>]+|(\([^\s()<>]+\)))*\)|[^\s`!()\[\]{};:\'".,<>?\xab\xbb\u201c\u201d\u2018\u2019]))',tag['href']):         cursor.execute("insert data_urls(links,parent,visited) values(%s,%s,'no')", (tag['href'],url))         file.write('\n')         file.write(tag['href'])             #file.close()    # cursor.execute("select * url")    # rows = cursor.fetchall()     mydb.commit()     process2(1)    def main():     if len(sys.argv) == 1:     print 'no url !!'               sys.exit(1)     url in sys.argv[1:]:         process(url)  main()

i got no error , nothing updated in database table desc:

+---------+---------------+------+-----+---------+-------+ | field   | type          | null | key | default | | +---------+---------------+------+-----+---------+-------+ | links   | varchar(1000) | yes  |     | null    |       | | parent  | varchar(1000) | yes  |     | null    |       | | visited | varchar(2)    | yes  |     | null    |       | +---------+---------------+------+-----+---------+-------+

change mydb = mysqldb.connect(host='localhost', user='root', passwd='shailang', db='mydb') cursor = mydb.cursor()

  def process2(url):   flag=0   cursor.execute("select links data_urls visited = ye")  yes_rows = cursor.fetchall()  cursor.execute("select links data_urls visited = no")  no_rows = cursor.fetchall()  count = len(no_rows)  in range(0, count):   print 'noooooooooo'   k= no_links   print k   j in range (i+1, count):     print "yessssssssssssss"         k1 = yes_links     print k1     if k1 == k :         print 'equals'         cursor.execute("update data_urls set visited =     'ye' links = %s",k)

help


Comments

Post a Comment

Popular posts from this blog

javascript - Slick Slider width recalculation -

-
i'm trying add slide in panel on slick container css. carousel works except new width not being calculated when space has been added. recalibrate once advance next slide i'd happen each time panel opened or closed. i've tried adding both margin , padding, neither makes difference. ideas? https://jsfiddle.net/mhigley/dpf7mlpl/ html: <button type="button" id="button"><i class="fa fa-arrow-right"></i></button> <aside> <h2>slide in panel</h2> <ol> <li>list item</li> <li>list item</li> <li>list item</li> <li>list item</li> <li>list item</li> </ol> </aside> <main role="main"> <div class="sections"> <section> <article> <h2>first slide</h2> <p>lorem ipsum d...
Read more

jsf - PrimeFaces Datatable - What is f:facet actually doing? -

-
looking through primefaces code in app noticed following line: <f:facet name="header">#{trainsearch.traincount} trains</f:facet> it looks overriding header, makes sense, can explain me in little more detail? what happening line of code? complete code listed below: <p:datatable id = "results" value = "#{trainsearch.trains}" var = "train" rendered="#{not empty trainsearch.trains}" styleclass = "train-search-table horizontal-border"> <f:facet name="header">#{trainsearch.traincount} trains</f:facet> <p:column headertext = "train id"> <p:panelgrid columns="1" styleclass = "train-id-grid" layout = "grid"> <h:outputtext styleclass = "train-id-label" value="#{train.traini}"/> <h:outputtex...
Read more

angular2 services - Angular 2 RC 4 Http post not firing -

-
i trying fire post request app , it's not working, tried multiple ways. don't see request being fired under network tab in chrome. not sure problem is, appreciated. import { injectable } '@angular/core'; import { http, headers } '@angular/http'; @injectable() export class userservice{ private _url="users"; constructor(private _http: http){ } checkifusernameexists(username){ return this._http.get(this._url+"/"+username) .map(response => response.json()) } createuser(user){ let headers = new headers(); headers.append('content-type', 'application/json') console.log(json.stringify(user)); return this._http.post(this._url, json.stringify(user),{headers: headers}) .map(response => response.json()) } } first need capture error , solve error: this._http.post(this._url, json.stringify(user),{headers: headers}) .subscribe( ...
Read more