목록STUDY/CRAWLING (4)

데이터 공부를 기록하는 공간

[crawling] requests - 배출권시세

참고 블로그 : https://wg-cy.tistory.com/54 ### https://blog.naver.com/ellijahbyeon/222213048898 import requests import pandas as pd import numpy as np from io import BytesIO import time import datetime from tqdm import tqdm import os ### generate.cmd ### payload - Form Data ''' locale: ko_KR trdDd: 20220603 share: 1 money: 1 csvxls_isNo: false name: fileDown url: dbms/MDC/STAT/standard/MDCSTAT15601 '..
STUDY/CRAWLING 2022. 6. 6. 00:02
[crawling] requests - krx 시세 가져오기

참고글 https://blog.naver.com/ellijahbyeon/222213048898 ✔ 라이브러리 ### https://blog.naver.com/ellijahbyeon/222213048898 import requests import pandas as pd from io import BytesIO ✔ 크롤링 함수 정의 path = 'C:/#####/####/test/' #### 저장주소, 주식데이터 def krx_basic(tdate): #### generate gen_req_url = 'http://data.krx.co.kr/comm/fileDn/GenerateOTP/generate.cmd' query_str_parms = { 'mktId': 'ALL', 'trdDd': str(tdate),..
STUDY/CRAWLING 2022. 6. 6. 00:00
[CRAWLING] beautifulsoup-kema

finding url 417 = 410 + 7 # kema url = 'http://www.k-ets.or.kr/bbs/board.php?bo_table=s6_1' res = requests.get(url) soup = BeautifulSoup(res.text, 'html.parser') # find 410 for i in soup.find_all('div', class_='div_td col_num'): temp = i.get_text().strip() if temp.isdigit(): point = temp print(point) break url2 = 'http://www.k-ets.or.kr/bbs/board.php?bo_table=s6_1&wr_id={}'.format(int(point)+7) ..
STUDY/CRAWLING 2022. 5. 28. 00:21
[CRAWLING] OPENAPI - smp

■ Library import pandas as pd import matplotlib.pyplot as plt import datetime import requests from bs4 import BeautifulSoup sns.set_context("talk") sns.set_style("white") import platform from matplotlib import font_manager, rc path="c:\Windows\Fonts\malgun.ttf" if platform.system() == 'Darwin': rc('font',family='AppleGothic') elif platform.system() == 'Windows': font_name=font_manager.FontProper..
STUDY/CRAWLING 2022. 5. 27. 23:41
Prev 1 Next