Tagged Questions
5
votes
1answer
494 views
Python Connection with MySQL
I want to share something with this community. I did a class connection between Python and MySQL. I hope you can help me with this project and help me do a better class.
Here is the class ...
3
votes
1answer
193 views
Monthly rollover system
I have learned a little python for a few projects at work. This is my first "finished" application and I was hoping someone would take a look at it. I would love some tips on the noob mistakes I am ...
3
votes
1answer
81 views
Help with optimizing current data pulling fuctions
Here is what the below code does:
The first function, sqlPull() connects to a local MySQL database and pulls the last 20 rows from the database every 5 seconds. The data coming in is a list of ...
2
votes
1answer
9k views
Inserting data into database by Python
I have to run a python script that enters data into MySQL database table.
My below query runs and inserts data into MySQL database. But I want to optimize it and I have 2 requests:
I want to use ...
5
votes
1answer
884 views
How to optimize a pipline for storing item in mysql?
I am using scrapy framework for data scraping and dumping item in MySQL database.
Here is my pipeline that is inserting output to MySQL, but its taking so much time. Any suggestions on how to ...
3
votes
2answers
676 views
Improve multithreading with network IO and database queries
I'm writing a script that:
fetch a list of urls from a db (about 10000 urls)
download all the pages and insert them into the db
parse the code
if(some condition) do other inserts into the db
I ...
4
votes
6answers
621 views
