Python 3.6 이상에서 urllib.request를 사용하는 방법을 한 번쯤 정리해야겠다 생각했었다. 오늘은 기분도 꿀꿀하고 발도 삔 김에...
urlopen
- http.client.HTTPResponse 객체를 반환한다.
- 입력은 url 값이다.
HTTPResponse 함수 목록
- read(): Reads and returns the response body, or up to the next amt bytes.
- getheaders(): Return a list of (header, value) tuples.
- status
- closed
pathname2url
로컬 드라이브의 패스를 URL로 고쳐준다.
url2pathname
pathname2url과 반대 기능
Request
class urllib.request.Request(url, data=None, headers={}, origin_req_host=None, unverifiable=False, method=None)
method는 'GET'혹은 'POST'이다. 'POST'일 때는 data가 제공된다.
- Request.full_url
- Request.type
- Request.data
- Request.method
- Request.get_method()
- Request.add_header(key, val)
- Request.remove_header(header)
- Request.get_full_url()
- Request.set_proxy(host, type)
- Request.get_header(header_name, default=None)
- Request.header_items()
Examples
>>> import urllib.request
>>> with urllib.request.urlopen('http://www.python.org/') as f:
... print(f.read(300))
...
b'<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">\n\n\n<html
xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">\n\n<head>\n
<meta http-equiv="content-type" content="text/html; charset=utf-8" />\n
<title>Python Programming '
>>> with urllib.request.urlopen('http://www.python.org/') as f:
... print(f.read(100).decode('utf-8'))
...
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtm
>>> import urllib.request
>>> f = urllib.request.urlopen('http://www.python.org/')
>>> print(f.read(100).decode('utf-8'))
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtm
>>> import urllib.request
>>> req = urllib.request.Request(url='https://localhost/cgi-bin/test.cgi',
... data=b'This data is passed to stdin of the CGI')
>>> with urllib.request.urlopen(req) as f:
... print(f.read().decode('utf-8'))
...
Got Data: "This data is passed to stdin of the CGI"
import urllib.request
DATA = b'some data'
req = urllib.request.Request(url='http://localhost:8080', data=DATA,method='PUT')
with urllib.request.urlopen(req) as f:
pass
print(f.status)
print(f.reason)
Authentification
import urllib.request
# Create an OpenerDirector with support for Basic HTTP Authentication...
auth_handler = urllib.request.HTTPBasicAuthHandler()
auth_handler.add_password(realm='PDQ Application',
uri='https://mahler:8092/site-updates.py',
user='klem',
passwd='kadidd!ehopper')
opener = urllib.request.build_opener(auth_handler)
# ...and install it globally so it can be used with urlopen.
urllib.request.install_opener(opener)
urllib.request.urlopen('http://www.example.com/login.html')
댓글
댓글 쓰기