cURL is a CLI tool for issuing HTTP GET, POST, & PUT request.
2
votes
1answer
31 views
how to add curlcpp to the library/include path?
I'm using Arch Linux and have successfully built https://github.com/JosephP91/curlcpp
However, I have no idea how to build the example program. I keep getting
fatal error: curl_easy.h: No such file ...
-4
votes
1answer
35 views
cURL for loop variable [closed]
Is there a way to write a for loop with a URL and change the URL each time? I want to append &skip=XX with different numbers to skip, is there a way to write it so that the variable is in the URL?
...
2
votes
1answer
37 views
Extract download progress from curl output
I'm trying to extract the download progress of a file that's being retrieved by curl.
I tried this, but this doesn't work:
curl --progress-bar http://127.0.0.1/test.tar.bz2 -o test.tar.bz2 ...
14
votes
3answers
575 views
why would curl and wget result in a 403 forbidden?
I try to download a file with wget and curl and it is rejected with a 403 error (forbidden).
I can view the file using the web browser on the same machine.
I try again with my browser's user agent, ...
1
vote
1answer
56 views
Login site using cURL
I am trying to login from cURL command line with the command
curl --data "username=user&password=pass&submit=Login" http://www.ip.com:8080/LoginApplication/Login.jsp
And after that trying to ...
-1
votes
1answer
38 views
Click a link to download file using curl [closed]
I have an HTML page on which several links are there, I want to click one link and that will download relevant file for me. How do I simulate this using curl.
All links have different name attribute
1
vote
1answer
43 views
How to use cURL commandline to download a file, for which the link is hidden(activates on-click only)
I was referring to this question. However, I am wondering how to do the same with curl.
So far, I have tried the following:
curl -O output.rar --referer http://subs.sab.bz/ ...
0
votes
1answer
20 views
Uploading a file over FTPS
As the title says, I need to automatically upload an excel file to a FTPS server. Right now I'm using curl but if there is a better option out there, I'm all ears.
What I have so far:
curl -k ...
0
votes
1answer
40 views
Download all source files for a webpage
I want to download the source files for a webpage which is a database search engine. Using curl I'm only able to download the main html page. I would also like to download all the javascript files, ...
2
votes
0answers
40 views
Difference between “curl -XPUT --data-binary @${file_path}” and “curl -XPUT -T ${file_path}”?
While using curl to POST or PUT a file to a url, there are two different ways to load the file content:
-T ${file_path}
--data-binary @${file_path} or -d $@{file_path} (for ascii data files)
What ...
1
vote
1answer
22 views
Wget or curl a self-signed certificate from server
From my browser, I can browse to a machine in my companies local intranet and (after marking the certificate as trusted) export that certificate to a file. I'm trying to automate this process into a ...
0
votes
0answers
59 views
How to add SSL with cURL URL using Ubuntu Terminal
While running a Twitter API from cURL in Ubuntu Terminal it asked me to use SSL. After searching for it, I tried:
sudo curl -s https://localhost:8080/tweets/HLaddha
sudo curl -k ...
3
votes
2answers
166 views
Is there a command line method by which I can check whether a downloaded file is complete or broken?
I'm writing a script that involves downloading and manipulating a file, and I want to ensure that the file is not incomplete (due to e.g. a dropped connection) before I work on it.
2
votes
0answers
42 views
Problems uploading a file via WebDAV?
I've configured on my Linux server (SLES11) with IHS Webserver with WebDAV enabled. A file upload via curl is successful using a URL like this:
$ curl --insecure --upload-file testfile.txt \
...
0
votes
1answer
139 views
Proper escaping of double quotations for curl post data?
I'm trying to test out a server, by sending it JSON data and reading the response.
I need to POST data like {"item":"value with spaces"} but when I use curl I find that it sends the backslashes as ...
0
votes
2answers
138 views
How to run a command with a hidden password
I need to run a curl command that accesses a website that another person has the password to.
e.g.
curl --basic --user myfriendsname:friendspassword http://www.updateinfo.com
I need a way where I ...
1
vote
1answer
97 views
curl url call in for loop? [closed]
I am working with bash and I am trying to make a curl url call in a for loop.
Below is my simple curl call -
curl -v --header "Connection: keep-alive" ...
1
vote
0answers
46 views
phpcurl not able to install on terminal
I am not able to install packages php and curl. But its gives dependencies error, please check below
curl : Depends: libcurl3 (= 7.29.0-1ubuntu3.4) but 7.32.0-1ubuntu1 is to be installed
...
3
votes
2answers
106 views
How to check whether a command such as curl completed without error?
I am using curl to upload a file to a server via an HTTP post.
curl -X POST [email protected] server-URL
When I manually execute this command on the command line, I get a response from the server like ...
0
votes
3answers
75 views
How to display the complete address with curl in searching?
I need to display the complete address with curl, when it find results with '301' status code.
This is my variable.
search=$(curl -s --head -w %{http_code} ...
1
vote
2answers
428 views
Using curl to access basic auth protected website via proxy (polipo)
I am trying to download a file protected via basic auth:
curl "http://User:[email protected]/blub/bla.bin"
This is working fine.
As soon as I tell curl to use my locally installed polipo it fails:
...
4
votes
3answers
179 views
download only first few bytes of a source page
I am downloading the HTML source page of a website using cURL command. The problem is, I do not want most of the contents in the page. I just need the first 100 lines of the source page. Is there a ...
0
votes
1answer
18 views
curl does not return any thing for protected file
I have a file on the server that is HTTP Head password protected, but when I tried to get the page the command returned with nothing at all:
curl --user username:password http://mysite.com
0
votes
1answer
396 views
Failed to connect to dl.google.com port 443: Network is unreachable
$ curl -v https://dl.google.com/dl/cloudsdk/release/install_google_cloud_sdk.bash | bash
* STATE: INIT => CONNECT handle 0x2001f130; line 1011 (connection #-5000)
* Hostname was NOT found in DNS ...
0
votes
0answers
26 views
curl unable to find cslistener
netstat shows some connection from my linux box to remote host on their cslistener port. But trying to access that port using curl is giving error :
$ curl -v https://myapp.domain.com:cslistener
* ...
1
vote
1answer
273 views
Why does curl command take urls with parameters as input
I know both wget and curl. Being curious I read a little about their differences.
I recently tried to use curl with an url who has parameters and it turns out curl strips down the parameters from ...
2
votes
1answer
94 views
Understanding two flags and a dollar sign in a CURL command
I right clicked a post request in Chrome and selected Copy as cURL
I got a cURL command that includes the following
--data-binary $'------WebKitFormBound
I am used to seeing cURL requests that ...
0
votes
1answer
135 views
Use curl to download from a Url
I am trying to download a file from a url using curl:
$ curl -3 -v "https://atl1mmsget.msg.eng.t-mobile.com/mms/wapenc?location=XXXXXXXXXXX_14zbwk&rid=027"
Where the X is a digit in the phone ...
0
votes
1answer
386 views
Slow DNS resolve from curl/lynx etc
I have a strange issue with DNS resolving: Root of the problem is that I get curl errors: "Error executing HTTP request: name lookup timed out". Tried to ping some sites, all resolved fine (and fast). ...
0
votes
1answer
135 views
Uniq won't remove duplicate
I was using the following command
curl -silent http://api.openstreetmap.org/api/0.6/relation/2919627 http://api.openstreetmap.org/api/0.6/relation/2919628 | grep node | awk '{print $3}' | uniq
...
0
votes
2answers
869 views
curl command output in a variable [duplicate]
I am connecting to mySQL database using a shell script. After connecting to the mySQL database, I execute a query. The query gives me 300,000 URLs as the result.
For each of the 300,000 URLs I need ...
0
votes
1answer
156 views
What does this curl command do?
I'm really new to Unix and I can't figure out what this command does. From what I understand, it sends an HTTP POST request to a website. I don't know exactly what each line is supposed to do. Can ...
0
votes
1answer
198 views
How to print gmail inbox messages
I want to print inbox messages one by one (like cat someFile) so that I can parse the message contents.
something like printGmail InboxMesg1 | grep some | sed some
Using curl I can access the ...
0
votes
0answers
44 views
Drag and drop files with cURL
I know that curl supports file upload e.g. here. Is it possible to upload files to site which has HTML5 Drag and Drop box for file uploading
0
votes
2answers
74 views
download multiple files from sourceforge
Is there any way to download / mirror a folder structure with many files from sourceforge using wget/curl/similar tool?
I've seen some examples using rsync or scp but I think that works only for SF ...
0
votes
3answers
81 views
transfer file to remote host and append to file if existing
I have a command-line program that continuously generates output on the shell.
I would like to be able to transfer the output to another unix host for which I know IP, username and password.
...
0
votes
1answer
59 views
Curl command help
I'm trying to connect to a internal tool UI, then login and later logout.
The homepage is having 3 drop-down options and 2 tabs where we need to enter the IP & Port and then connect. Once ...
1
vote
1answer
139 views
Download attachments in a URL redirect via Axel
Axel is not resolving URLs that redirect to another URL that has the file as an attachment.
As you see, I'm getting 404 when I try to download this URL. (original site is replaced with example.com)
...
0
votes
2answers
311 views
Curl. Check redirect
Lets suppose that we have 3 links: link1, link2, link3. link1 redirects to link2 and link2 redirects to link3. So how to see that with curl?
1
vote
1answer
1k views
Running thousands of curl background processes in parallel in bash script
I am running thounsand of curl background processes in parallel in the following bash script
START=$(date +%s)
for i in {1..100000}
do
curl -s "http://some_url_here/"$i > $i.txt&
...
1
vote
1answer
157 views
curl ignores interface parameter
My Ubuntu 12.04 laptop is connected to the Internet by WiFi and to the intranet by cable.
I would like to get the content of an intranet site via curl and have tried the following:
curl --interface ...
0
votes
0answers
235 views
libcurl4-gnutls-dev : Depends: libldap2-dev but it is not going to be installed
I am trying to install curl in my ubuntu server as I was getting this error whenever I am compiling my C++ code -
fatal error: curl.h: No such file or directory
Below is the error:
...
0
votes
2answers
704 views
update curl on centos5
i have centos 5.9, with curl 7.15.5. i need curl 7.16.2+ .
i'm a novice webmaster...if that. but would like to try.
what are the commands to add a yum rpm repo so i can update the curl version, if ...
3
votes
3answers
7k views
Does curl have a timeout?
So far I couldn't find anything really, but is it true that curl doesn't really time out at all?
user@host:~# curl http://localhost/testdir/image.jpg
I'm asking because I'm redirecting any request ...
0
votes
0answers
234 views
Difference between curl -d `data` and curl -d @file
I would like to convert my configuration files for ElasticSearch from JSON to YML.
I am using curl for all REST related opertions overhanding the file via
$ curl -X PUT ...
2
votes
1answer
518 views
download pdf files from using curl
How to download hundereds of .pdf files from http://www.ncbi.nlm.nih.gov/pmc/articles using a loop, for example for the following document ids:
PMC3386155
PMC3625956
PMC3477654
PMC3531051
...
2
votes
1answer
122 views
How to download .pdf files from pubmed
I can't download .pdf files from http://www.ncbi.nlm.nih.gov/pmc/articles, I already have some document IDs such as PMC3404089.
I tried to issue the following command:
curl -o file.pdf ...
0
votes
3answers
387 views
Custom name output file wget or curl
For example I have a link http://www.abc.com/123/def/ghi/jkl.mno.
I want to download it using wget or curl and get the name of output file as def_ghi_jkl.mno, where the part def_ghi is taken from the ...
3
votes
3answers
1k views
Curl with ipv6 not working by default
I am trying to curl ipv6 addresses, but without success.
If I try lets say:
curl https://google.com
I wait for a timeout and get network unreachable
If I force ipv4, everything is fine.
...
1
vote
1answer
275 views
How to figure out where a link gets redirected
I currently working on a script that updates a file. The file has several versions. The important ones have static links. These get redirected to the actual file which then gets downloaded using wget. ...
