I am trying to clear Instagram and Twitter web pages based on geolocation. I can run a search query, but I am having problems reloading a web page to save more and save fields in a data frame.
I found some examples for twitter and Instagram web scripting without API keys. But they relate to the #tags keywords.
I am trying to clear up regarding geolocation and between old dates. so far I have come so far from writing code in python 3.X and all the latest packages in anaconda.
'''
Instagram - Components
"id": "1478232643287060472",
"dimensions": {"height": 1080, "width": 1080},
"owner": {"id": "351633262"},
"thumbnail_src": "https://instagram.fdel1-1.fna.fbcdn.net/t51.2885-15/s640x640/sh0.08/e35/17439262_973184322815940_668652714938335232_n.jpg",
"is_video": false,
"code": "BSDvMHOgw_4",
"date": 1490439084,
"taken-at=213385402"
"display_src": "https://instagram.fdel1-1.fna.fbcdn.net/t51.2885-15/e35/17439262_973184322815940_668652714938335232_n.jpg",
"caption": "Hakuna jambo zuri kama kumpa Mungu shukrani kwa kila jambo.. \ud83d\ude4f\ud83c\udffe\nIts weekend\n#lifeistooshorttobeunhappy\n#Godisgood \n#happysoul \ud83d\ude00",
"comments": {"count": 42},
"likes": {"count": 3813}},
'''
import selenium
from selenium import webdriver
from bs4 import BeautifulSoup
import pandas
query = geocode%3A35.68501%2C139.7514%2C30km%20since:2016-03-01%20until:2016-03-02&f=tweets
twitterURL = 'https://twitter.com/search?q=' + query
browser = webdriver.Firefox()
browser.get(twitterURL)
content = browser.page_source
soup = BeautifulSoup(content)
print (soup)
For Twitter request, Twitter I get syntax error
For Instagram, I don't get any errors, but I cannot reload more posts and write back to the csv dataframe.
I am also trying to search for latitude and longitude on Twitter and Instagram.
csv. .
.
!!