0

I am looking for a simple Linux/Ubuntu proxy which only purpose is record the request and the answer from a http transaction.

I am writing an application that will not run on a web browser but it will talk to a web server. I want to mimic, to learn how I should send properly a request to my web server by examining a valid transaction between a web browser and a web server.

This application will run in an Arduino, and this program will be written in C, so I can not rely on fancy libs and high level tools like curl or python running BeautySoup, for instance. Think on it as a tiny http browser that does not render HTML code, but only send requests and understand the answer.

I manage to use netcat in listing mode to capture the data sent by the browser, so my app already can send something similar, but I am in trouble to know what is the proper answer the web server reply with. Since my app needs to understand what is going on and take the next step.

I am using Postman to send the requests. Postman is great to that. The problem with Postman is I can not inspect the answer as raw data. It gives me the body of the answer, but not the header of the answer.

I am looking for a proxy that can output the raw data somewhere, both requests and answers, with the full header and body, as raw data.

I want to see something like this:

PUT /testAuth.php HTTP/1.1
Authorization: Basic Y291cmFnZTpkb2c=
User-Agent: PostmanRuntime/7.15.0
Accept: */*
Cache-Control: no-cache
Postman-Token: 7a4c180f-d893-4e7d-8375-a4dfd7b5663e
Host: localhost:80
accept-encoding: gzip, deflate
content-length: 0
Connection: keep-alive

HTTP/1.1 200 OK
Date: Thu, 04 Jul 2019 20:24:08 GMT
Server: Apache/2.4.38 (Ubuntu)
Content-Length: 36
Keep-Alive: timeout=5, max=100
Connection: Keep-Alive
Content-Type: text/html; charset=UTF-8

<h1>Hello, Authenticated User.</h1>

I think that understanding the whole HTTP protocol by reading the protocol specification will take so long until I get the point I can do it by my self. I think I can save time by just imitate a GET/PUT/POST request sent by Postman and seeing what I should expect on the answer.

So, I thought about a proxy that can output both the request and the answer and use that info as a template to build my own requests and parse the answer.

thank you in advance,

PS: Currently, I am using telnet to talk to the browser and receive the answer. The problem with it is I have to copy the request from somewhere and paste on telnet's input. And then, I receive the answer and the connection closes. It works, kind off. But I want to use Postman to build my requests and get the answer and see the details elsewhere.

0

I found mitmproxy (https://mitmproxy.org/) that worked just fine for inspecting the http flow !

best regards,

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.