티스토리 뷰

스크래핑,파싱

댓글 파싱

xemaker 2017. 11. 5. 23:23

댓글 파싱에 대한 의뢰도 많다.


댓글은 보통 따로 가져온다.


그래서 댓글을 소스 보기 하면 안나온다.


http://www.inven.co.kr/board/diablo3/5034/17119


여기의 댓글을 가져 오고 싶을때


크롬 -> Network 으로 가져온 다음 XHR을 선택하면 좀 추려진다.


그럼 comment 관련이 보인다. 


General

    1. Request URL:
      http://www.inven.co.kr/common/board/comment.xml.php?dummy=1509891497904
    2. Request Method:
      POST
    3. Status Code:
      200 OK
    4. Remote Address:
      182.162.110.129:80
    5. Referrer Policy:
      no-referrer-when-downgrade
  1. Response Headersview source
    1. Connection:
      keep-alive
    2. Content-Encoding:
      gzip
    3. Content-Type:
      application/xml; charset=utf-8
    4. Date:
      Sun, 05 Nov 2017 14:18:17 GMT
    5. Server:
      nginx
    6. Transfer-Encoding:
      chunked
  2. Request Headersview source
    1. Accept:
      */*
    2. Accept-Encoding:
      gzip, deflate
    3. Accept-Language:
      ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4
    4. Connection:
      keep-alive
    5. Content-Length:
      110
    6. Content-Type:
      application/x-www-form-urlencoded;charset=UTF-8
    7. Cookie:
      inven_link=stream; _ga=GA1.3.1794042350.1490890470; _gid=GA1.3.1856831501.1509887632; invenrchk=%7B%225034%7C16180%22%3A%7B%22d%22%3A%222017-10-16+01%3A41%3A48%22%2C%22s%22%3Anull%7D%2C%225034%7C16637%22%3A%7B%22d%22%3A%222017-10-26+22%3A18%3A47%22%2C%22s%22%3Anull%7D%2C%225034%7C16632%22%3A%7B%22d%22%3A%222017-10-26+22%3A19%3A38%22%2C%22s%22%3Anull%7D%2C%225034%7C17119%22%3A%7B%22d%22%3A%222017-11-05+23%3A18%3A15%22%2C%22s%22%3Anull%7D%2C%225034%7C17122%22%3A%7B%22d%22%3A%222017-11-05+23%3A15%3A47%22%2C%22s%22%3Anull%7D%7D; VISIT_SITE=diablo3
    8. Host:
      www.inven.co.kr
    9. Origin:
      http://www.inven.co.kr
    10. Referer:
      http://www.inven.co.kr/board/diablo3/5034/17119
    11. User-Agent:
      Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.100 Safari/537.36
  3. Query String Parametersview sourceview URL encoded
    1. dummy:
      1509891497904
  4. Form Dataview sourceview URL encoded
    1. comeidx:
      5034
    2. articlecode:
      17119
    3. sortorder:
      date
    4. uploadurl:
    5. imageposition:
    6. act:
      list
    7. out:
      xml
    8. replynick:
    9. replyidx:
      0


위의 정보를 기반으로 스누피를 통해 만든다.


<?

include "Snoopy.class.php";

$snoopy = new Snoopy;

$submit_url = "http://www.inven.co.kr/common/board/comment.xml.php?dummy=15090067137";

$submit_vars["comeidx"] = "5034";

$submit_vars["articlecode"] = "17119";

$submit_vars["sortorder"] = "date";

$submit_vars["act"] = "list";

$submit_vars["out"] = "xml";

$submit_vars["replyidx"] = "0";

$snoopy->submit($submit_url,$submit_vars);

print $snoopy->results;

?>


그럼 잘 가져온다.


결과


<?xml version="1.0" encoding="utf-8"?>
<resultdata>
<message>1</message>
<cmtcount>7</cmtcount>
<pagecount>100</pagecount>
<lastblock>0</lastblock>
<addcomment>0</addcomment>
<commentlist titlenum='0'>
<item cmtidx="81460" cmtpidx="81460" state="Y" bestBg="0" adminflag="0" dice="0" chkGuest="0" amaflag="0">
<o_date>2017-11-05 21:55:07</o_date>
<o_name>등껍질</o_name>
<o_icon>0</o_icon>
<o_comment>룬에&amp;nbsp;극확&amp;nbsp;5씩&amp;nbsp;증가시켜주는거&amp;nbsp;있어서&amp;nbsp;극확필요가&amp;nbsp;없어요. </o_comment>
<o_recommend>0</o_recommend>
<o_notrecommend>0</o_notrecommend>
<o_level>lv50</o_level>
<certuser>1</certuser>
<chkGoodBad>1</chkGoodBad> <chkReply>1</chkReply> </item>
<item cmtidx="81461" cmtpidx="81460" state="Y" bestBg="0" adminflag="0" dice="0" chkGuest="0" amaflag="0">
<o_date>2017-11-05 21:55:43</o_date>
<o_name>김와루</o_name>
<o_icon>0</o_icon>
<o_comment>그게뭐에요?&amp;nbsp;아예&amp;nbsp;그냥&amp;nbsp;대균솔플이건&amp;nbsp;일균솔플이건&amp;nbsp;그냥&amp;nbsp;극확이&amp;nbsp;안필요한거에여? </o_comment>
<o_recommend>0</o_recommend>
<o_notrecommend>0</o_notrecommend>
<o_level>lv06</o_level>
<certuser>1</certuser>
<chkGoodBad>1</chkGoodBad> </item>
<item cmtidx="81465" cmtpidx="81465" state="Y" bestBg="0" adminflag="0" dice="0" chkGuest="0" amaflag="0">
<o_date>2017-11-05 21:59:11</o_date>
<o_name>Symarine</o_name>
<o_icon>0</o_icon>
<o_comment>시체창&amp;nbsp;냉기&amp;nbsp;룬을&amp;nbsp;보시면&amp;nbsp;맞은&amp;nbsp;적이&amp;nbsp;5초간&amp;nbsp;극확&amp;nbsp;5%&amp;nbsp;추가&amp;nbsp;디버프를&amp;nbsp;받는데
이&amp;nbsp;효과가&amp;nbsp;극확&amp;nbsp;100까지&amp;nbsp;중첩됩니다.
어차피&amp;nbsp;장갑이나&amp;nbsp;성물&amp;nbsp;같은&amp;nbsp;경우&amp;nbsp;극확&amp;nbsp;빼고&amp;nbsp;넣을&amp;nbsp;만한&amp;nbsp;옵션도&amp;nbsp;없어서
반지,&amp;nbsp;목걸이&amp;nbsp;정도에서&amp;nbsp;극확을&amp;nbsp;빼면&amp;nbsp;됩니다 </o_comment>
<o_recommend>0</o_recommend>
<o_notrecommend>0</o_notrecommend>
<o_level>lv62</o_level>
<certuser>1</certuser>
<chkGoodBad>1</chkGoodBad> <chkReply>1</chkReply> </item>
<item cmtidx="81466" cmtpidx="81465" state="Y" bestBg="0" adminflag="0" dice="0" chkGuest="0" amaflag="0">
<o_date>2017-11-05 21:59:40</o_date>
<o_name>Symarine</o_name>
<o_icon>0</o_icon>
<o_comment>역병시창&amp;nbsp;반지의경우&amp;nbsp;극피&amp;nbsp;공속&amp;nbsp;재감,
목걸이의경우&amp;nbsp;냉피&amp;nbsp;공속&amp;nbsp;극피가&amp;nbsp;졸업옵입니다 </o_comment>
<o_recommend>0</o_recommend>
<o_notrecommend>0</o_notrecommend>
<o_level>lv62</o_level>
<certuser>1</certuser>
<chkGoodBad>1</chkGoodBad> </item>
<item cmtidx="81467" cmtpidx="81465" state="Y" bestBg="0" adminflag="0" dice="0" chkGuest="0" amaflag="0">
<o_date>2017-11-05 22:01:26</o_date>
<o_name>김와루</o_name>
<o_icon>0</o_icon>
<o_comment>아하&amp;nbsp;그렇군여&amp;nbsp;감사합니다&amp;nbsp;ㅎㅎ&amp;nbsp;극확을&amp;nbsp;안맞춰도되다니..&amp;nbsp;ㅎㅎ&amp;nbsp;좋네여&amp;nbsp;! </o_comment>
<o_recommend>0</o_recommend>
<o_notrecommend>0</o_notrecommend>
<o_level>lv06</o_level>
<certuser>1</certuser>
<chkGoodBad>1</chkGoodBad> </item>
<item cmtidx="81468" cmtpidx="81465" state="Y" bestBg="0" adminflag="0" dice="0" chkGuest="0" amaflag="0">
<o_date>2017-11-05 22:02:57</o_date>
<o_name>Symarine</o_name>
<o_icon>0</o_icon>
<o_comment>네&amp;nbsp;그리고&amp;nbsp;전체적으로&amp;nbsp;트래때보단&amp;nbsp;재감도&amp;nbsp;높아&amp;nbsp;망땅&amp;nbsp;쿨도&amp;nbsp;빨리&amp;nbsp;돌아오고
냉기&amp;nbsp;룬이라&amp;nbsp;그런지&amp;nbsp;시창&amp;nbsp;이펙트가&amp;nbsp;시원시원&amp;nbsp;합니다
재밌으실거에요 </o_comment>
<o_recommend>0</o_recommend>
<o_notrecommend>0</o_notrecommend>
<o_level>lv62</o_level>
<certuser>1</certuser>
<chkGoodBad>1</chkGoodBad> </item>
<item cmtidx="81469" cmtpidx="81465" state="Y" bestBg="0" adminflag="0" dice="0" chkGuest="0" amaflag="0">
<o_date>2017-11-05 22:03:34</o_date>
<o_name>김와루</o_name>
<o_icon>0</o_icon>
<o_comment>넵&amp;nbsp;지금&amp;nbsp;한지&amp;nbsp;얼마안되서&amp;nbsp;겨우&amp;nbsp;인검&amp;nbsp;역병식으로&amp;nbsp;맞춰놓은&amp;nbsp;정도인데도&amp;nbsp;시원시원하고&amp;nbsp;좋네여&amp;nbsp;ㅎㅎ </o_comment>
<o_recommend>0</o_recommend>
<o_notrecommend>0</o_notrecommend>
<o_level>lv06</o_level>
<certuser>1</certuser>
<chkGoodBad>1</chkGoodBad> </item>
</commentlist>
</resultdata>


'스크래핑,파싱' 카테고리의 다른 글

네이버 xml을 php xml 파싱하는 방법  (0) 2017.11.09
php xml 파싱 simple_load_xml 속성값 가져오기  (0) 2017.11.08
파싱,스크래핑,크롤링 의뢰시 좋은 예  (0) 2017.06.15
유닉스/리눅스 웹 페이지 호출 - curl 사용방법  (0) 2017.04.23
xe 파싱시 제목으로 중복 체크 하는 방법  (0) 2017.04.23
공유하기 링크
댓글
공지사항
최근에 올라온 글
최근에 달린 댓글
Total
Today
Yesterday
링크
TAG more
«   2025/07   »
일 월 화 수 목 금 토
1 2 3 4 5
6 7 8 9 10 11 12
13 14 15 16 17 18 19
20 21 22 23 24 25 26
27 28 29 30 31
글 보관함