Commit Graph

362 Commits

Author SHA1 Message Date
kennethreitz e37b40e59f Merge pull request #189 from carrionc/patch-2
Multiple chromium tab fix
2018-09-18 02:42:54 -04:00
kennethreitz e05933acfc Merge pull request #191 from montenegrodr/patch-1
fix: typo
2018-09-18 02:42:43 -04:00
kennethreitz 5de8c88a1f Merge pull request #203 from rachmadaniHaryono/master
exclude html files for github linguist
2018-09-18 02:42:34 -04:00
kennethreitz 5d7c859975 Merge pull request #193 from pennyarcade/master
Update requests_html.py
2018-09-18 02:41:02 -04:00
kennethreitz 16c0dbe13d Merge pull request #201 from timotk/patch-1
Fix minor typo
2018-09-18 02:40:16 -04:00
kennethreitz 87b183c7fc Merge pull request #205 from leven-cn/develop
Add "tag" attribute for Element objects
2018-09-18 02:40:06 -04:00
kennethreitz 95a113cfc3 Merge pull request #217 from m9mhmdy/master
Fix a small typo
2018-09-18 02:37:40 -04:00
kennethreitz ee34f3f9ea Update README.rst 2018-09-17 08:07:49 -04:00
kennethreitz d159d2045a Update README.rst 2018-09-17 08:07:22 -04:00
kennethreitz 6190a47eef Update README.rst 2018-09-17 08:06:43 -04:00
m9mhmdy cb6e5fb557 Fix a small typo 2018-08-30 16:25:25 +02:00
Li Yun 1c21f63672 Add "lineno" attribute for Element object 2018-07-04 11:30:59 +08:00
Li Yun 116a4b08eb Add "tag" attribute for Element object 2018-07-04 11:20:08 +08:00
rachmadaniHaryono 96973aaf4e chg: dev: generic html 2018-07-02 21:49:28 +08:00
rachmadaniHaryono 6fef1d8583 new: dev: ignore html count 2018-07-02 21:44:00 +08:00
Timo 71e2571d3a Fix minor typo
lopp -> loop in init docstring of AsyncHTMLSession.
2018-06-25 13:18:57 +02:00
Martin Rotwang 96dbba8fbd Update requests_html.py
e.g. to add a proxy setting
usage: s=Session(browser_args=['--no-sandbox', '--proxy-server=127.0.0.1:9876'])
@see: https://github.com/GoogleChrome/puppeteer/issues/336
2018-06-05 12:39:46 +02:00
Robson D. Montenegro a1c5e6ac8b fix: typo 2018-06-03 21:52:51 +01:00
carrionc 956e60054c Multiple chromium tab fix
Within the render function, the page is rendered through the _async_render function. This function will try to render content by first creating a page, and currently will only close said page if the content is generated. However, if at any point there's a timeout beforehand, the current page isn't closed, and instead _async_render will be called again [as per the # assigned to retries in render()] and end up leaving behind an unused page. This change will enable render to close the "failed" attempt BEFORE opening a new page to try again, and should fix the issue of massive cpu buildup with multiple chromium instances. Sorry if this is messy, it's my first time using git to make a change.
2018-05-30 00:40:37 -04:00
kennethreitz c59480bf15 v0.9.0
Signed-off-by: Kenneth Reitz <me@kennethreitz.org>
v0.9.0
2018-03-21 07:50:17 -04:00
kennethreitz ad0ded932a next version
Signed-off-by: Kenneth Reitz <me@kennethreitz.org>
v0.8.4
2018-03-21 07:47:28 -04:00
kennethreitz 550d79f4c0 pipfile
Signed-off-by: Kenneth Reitz <me@kennethreitz.org>
2018-03-21 07:47:15 -04:00
kennethreitz 122b42a144 cleanup
Signed-off-by: Kenneth Reitz <me@kennethreitz.org>
2018-03-21 07:46:27 -04:00
kennethreitz 30b59cc25c pin 0.0.14
Signed-off-by: Kenneth Reitz <me@kennethreitz.org>
v0.8.3
2018-03-21 07:33:31 -04:00
kennethreitz c314de170f v0.8.3
Signed-off-by: Kenneth Reitz <me@kennethreitz.org>
2018-03-21 07:33:03 -04:00
kennethreitz 8478388670 pipfile.lock
Signed-off-by: Kenneth Reitz <me@kennethreitz.org>
2018-03-21 07:32:46 -04:00
kennethreitz 2778850a48 cleanup tests
Signed-off-by: Kenneth Reitz <me@kennethreitz.org>
2018-03-21 07:32:33 -04:00
kennethreitz cf0121962e Merge pull request #144 from oldani/bugfix/issue_132
Bugfix/issue 132
2018-03-21 07:24:19 -04:00
Ordanis Sanchez a2cc6bfa55 Update HTML.render to use session.browser anf close pages automatically 2018-03-20 19:50:04 -04:00
Ordanis Sanchez 9a53202ce5 Extend session close method to shutdown browser 2018-03-20 19:20:20 -04:00
Ordanis Sanchez 9a8748a832 Add psutil dev dependency 2018-03-20 19:16:30 -04:00
Ordanis Sanchez c279bd3d63 Add browser obj to HTMLSession 2018-03-20 18:47:06 -04:00
kennethreitz ef67e9f96f Merge pull request #141 from oldani/bugfix/issue_135
Catch typeError on render, add maxretires exception
2018-03-20 17:11:53 -04:00
kennethreitz 2ef3d41f41 Merge pull request #136 from oldani/bugfix/html_sessions
Bugfix/html sessions
2018-03-20 17:11:37 -04:00
Ordanis Sanchez ff95aded81 Catch typeError on render, add maxretires exception 2018-03-16 12:02:03 -04:00
Ordanis Sanchez 9b21faf291 Update Sessions classes to be passed down to HTML class 2018-03-14 10:31:36 -04:00
Ordanis Sanchez a79e5479de Move next method form BaseParser to HTML class 2018-03-14 10:16:40 -04:00
kennethreitz 0f05293ad0 Merge pull request #134 from bonfy/master
add func add_next_symbol make it possible to append word to default next page symbols
2018-03-13 12:56:26 -04:00
bonfy 76f2f6434c add func add_next_symbol make it possible to append word to default next page symbols 2018-03-13 11:11:07 +08:00
kennethreitz 32c1c983f9 8.0.2
Signed-off-by: Kenneth Reitz <me@kennethreitz.org>
v0.8.2
2018-03-12 06:26:21 -04:00
kennethreitz 7db267269e next version 2018-03-12 06:25:04 -04:00
kennethreitz 6f8b676ac3 Merge branch 'master' of github.com:kennethreitz/requests-html 2018-03-11 09:44:55 -04:00
kennethreitz bcbcbbd5d4 Merge pull request #129 from shaunpud/master
Shorten
2018-03-11 08:06:21 -04:00
shaunpud d55bcfb34f Shorten 2018-03-11 19:53:54 +08:00
kennethreitz bcb0881d15 Merge pull request #126 from frostming/bugfix/links
Fix bugs related to links
2018-03-11 07:37:20 -04:00
kennethreitz 5b0bfbdae1 Merge pull request #120 from miyakogi/patch-1
Pyppeteer's api has been changed
2018-03-11 07:37:05 -04:00
Frost Ming af97ddd5f1 Fix bugs related to links
* #121 KeyError of special base tag
* #124 Remove 'mailto:' links out from links
2018-03-11 16:26:58 +08:00
kennethreitz c0680d3f41 Merge pull request #123 from erinxocon/patch-1
xpath didn't actually do anything from the example on README.rst
2018-03-10 20:12:05 -05:00
Erin O'Connell 22b3fd546e xpath didn't actually do anything 2018-03-10 16:44:02 -07:00
miyakogi c46c66ba4a Update Pipfile.lock 2018-03-10 23:16:06 +09:00