cURL is a library and command-line tool for transferring data using several protocols such as HTTP, FTP and Telnet.
2
votes
1answer
52 views
Combining json responses of recursive web service calls with PHP and curl
I'm implementing the Hotel Price List API from Skyscanner. This requires a first call to the service to implement a session followed by 1 or more calls to the service to get the actual results. I've ...
1
vote
2answers
74 views
Sending email using libcurl - follow-up 2
This question is a continuation of: Sending email using libcurl - follow-up
Does this code have any problems? Can I improve it?
...
0
votes
2answers
88 views
Movie data scraping
I enter in the IMDb link and YouTube trailer link in the command line to a movie and the first main program loads all the info about the movie. The second main program uses an IMDb link to the movie ...
3
votes
1answer
77 views
Sending email using libcurl - follow-up
This question is continuation of: Sending email using libcurl
I developed a class to send email. Does this code have any problems? Is it thread-safe?
...
2
votes
2answers
163 views
Sending email using libcurl
I developed a function to send email based on this. Does this code have problems? Also, I'm not sure if this code is thread-safe because of the global payloadText ...
1
vote
1answer
33 views
Extracting site visit information from a REST API call, including addresses from a MySQL database
I'm building a web app that pulls data from a ticketing system via REST API. I'm currently able to pull all of the data I need just fine but the loading process is really slow. I'd love any feedback ...
3
votes
1answer
35 views
Parses XML to return the bus times at specified bus stop
The code uses the XML-based OC Transpo data feed to create a list of the bus name, where it's headed, and the times. Keep in mind that I am a beginner at python so any advice at all is appreciated.
<...
1
vote
1answer
178 views
Using cURL to retrieve remote image
I am using the following code to retrieve the URL of a random image in a remote folder that I own.
As a newbie and although this is working I would like to know if this is done properly, if it could ...
1
vote
2answers
59 views
Crawling SPOJ through cURL and C++
I am trying to write industry standard code.
https://www.quora.com/How-do-I-follow-a-user-on-Spoj-for-solving-problems-Refer-Details
Someone gave me this A2A.
And I wrote this code for it
...
3
votes
2answers
101 views
calloc, malloc, free and realloc wrappers to store the size being allocated
I'm currently building a node.js addon for libcurl. Right now I'm trying to correctly use v8::Isolate::GetCurrent()->AdjustAmountOfExternalAllocatedMemory to ...
1
vote
0answers
19 views
3
votes
1answer
70 views
4
votes
0answers
86 views
Reusing curl easy handles in C
In a C project I want to reuse curl easy handles. The flow of program is like:
Client --> C Application --> Call URL1, do something, Call URL2, do something, Call URL3...
In short, for each client ...
4
votes
1answer
184 views
Pulling data from API, Allowed memory exhausted
I'm working on a project where I pull data (JSON) from an API. I would like to manipulate this data and store this as useful information in my DB (MySQL). My code is working if I would like to make, ...
1
vote
0answers
127 views
URL image validation
I'm trying to write a method to validate an image from a URL. The method will accept an array of image URL. The image should be validated by its type, size and dimensions. Right now, I'm able to ...
1
vote
1answer
89 views
Checking whether a site is up or down
I have this PHP curl function to check if a site is online or not:
...
10
votes
2answers
449 views
Sending an SMS message in C
Recently I've been fiddling with the idea of sending a text message using C. Looking at a few options, I thought that using libcurl to send an SMTP email using TLS for some security would be the best ...
3
votes
1answer
198 views
cURL GET requests receiving XML data
First of all, I would like to know if there is any difference (execution-time) in C between:
GET request made by using cURL
GET request make by using sockets (BSD sockets)
Second, I've done a C ...
2
votes
2answers
818 views
Upload image from Remote Server using URL
This PHP class is to allow user to enter a URL of a remote image file and have it download the image to local server. It will be used in a Markdown editor just like Stack Overflow / Stack Exchange ...
7
votes
1answer
98 views
Testing uptime of my personal server
I made some code to test my personal servers uptime. It logs in to my router page and sees if it returns status 200. A cron job runs it every 5 minutes. Please let me know if I can make the code more ...
1
vote
1answer
68 views
DMZ passthru script
I have a server that cannot be connected to from the internet, but I need to get some info to it. I have another server that can, so I have a simple passthru script that I want to see if you all think ...
9
votes
2answers
2k views
Pinging a URL with libcurl
I've asked a question about pinging a URL before, but I wanted something that was a bit shorter and still just as efficient. libcurl seemed to be the perfect answer. Here is my method:
...
10
votes
3answers
125 views
Dynamic library to intercept oddsock hostname lookups
Just for the fun of it, I decided I would try to create sort of an intermediate DNS system for the oddsock SOCKS proxy. With this, the domain name extension .unet is statically resolved when requested....
5
votes
1answer
112 views
Reverse-engineering with Filepicker API
I have this script to pull data out of the Filepicker API internal. It's mostly reverse-engineering and the code seems to be ugly to me. How can this be improved?
...
8
votes
1answer
229 views
Optimize web-scraping of Moscow grocery website
This code works fine, but I believe it has optimization problems. Please review this.
Also, please keep in mind that it stops after each iteration of the loop ...
8
votes
1answer
515 views
Bash script to clone all public repos or gists for a specified user, optionally to a directory of choice
I wrote this script as a way to backup and/or download quickly a set of repos or gists from a user. I don't have any major concerns but I'm a noob at bash scripting, and I've been scouring the ...
4
votes
1answer
2k views
Wrapping Curl, an HTTP client
I have written an HTTP client wrapped the libcurl. It should be able to do HTTP get/post with string/map param, with cookies and proxy.
Can somebody review the code? B.T.W., I'm not sure the way ...
2
votes
1answer
206 views
Webhook Structuring
I am building a Webhook model so users can receive data from a messaging app.
I have never created such a system before, and I'd like to get some feedback on my attempt.
...
9
votes
1answer
343 views
HTTP Stream Part 2 A stream that opens an HTTP GET and then acts like a normal C++ istream
The review I asked for yesterday was for a header only library.
HTTP Stream A stream that opens an HTTP GET and then acts like a normal C++ istream
This has some limitations as it downloads all the ...
12
votes
1answer
768 views
Stream that opens an HTTP GET and then acts like a normal C++ istream
Needed a quick stream to get JSON objects.
...
2
votes
1answer
95 views
Downloading the oldest available version of some data files
I am using the cURL tool in MATLAB 2013b with Ubuntu to download a whole bunch of files. The files have one of three possible versions: 1.0.0, 2.0.0, or 2.1.0. Using the HTTP, I first check the ...
2
votes
1answer
319 views
Bash script to monitor Webserver php script
Below is a script I wrote today to use CURL to monitor the length of various HTTP server outputs and output a response if this is different than 103 characters.
This is my first bash script, so I had ...
2
votes
3answers
638 views
Service status checker… Is there a more efficient way?
I've been working on a website status checker.. However this array that I use has around 30 sites within it, I've noticed it's taking around 6-7 seconds to load it.
I was wondering if there's any ...
5
votes
1answer
1k views
Secure CURL to & handle response from Payment Gateway
I'm using a payment gateway and am trying to implement the post and response handling with CURL so that it all happens on one page.
The following is tested and works but I want to double check it's ...
1
vote
3answers
7k views
Calling restful web services efficiently
I need to use this code to fetch data from web service and show them in a site properly but after I request for the webservice I am unable to load them fast. Site is loading very slow.
...
3
votes
1answer
569 views
Optimizing PHP script fetching entire HTML pages
The following script should get links which are stored in a text file (line by line), then put them into an array and finally scan each links' source code for a certain line. If this line is found, it ...
3
votes
1answer
2k views
DownloadFile Function (using LibCurl)
Please tell me if this function is correct (I believe it to be), efficient, and clean.
Function to check:
...
4
votes
2answers
3k views
Improve multithreading with network IO and database queries
I'm writing a script that:
fetch a list of urls from a db (about 10000 urls)
download all the pages and insert them into the db
parse the code
if(some condition) do other inserts into the db
I have ...
2
votes
1answer
201 views
Getting a remote file to local storage
I've prepared a function using cURL to get a remote file to the local storage:
...
3
votes
1answer
3k views
Tiny Curl C++ wrapper
I have written this sample code to fetch a web page in C++ using libcurl. Please review it.
...
4
votes
1answer
261 views
Dynamic IP-address logging
Inspired by Don Stewart's article on Scripting with Haskell I tried a rewrite of a shell-script I did the other day. I was really astonished how easily it worked but as a whole it is about double the ...
11
votes
2answers
5k views
Handling many networking exceptions in Ruby
What would be a prettier/faster way to do handling of multiple errors in Ruby? Here is the code I am working with:
...
