Location and Search Engine
Location and Search Engine
Location and Search Engine
LOCATION ANALYTICS
GPS-BASED
GPS is a satellite-based navigation system that can be used find exact
location people and resources. Mobile analytics mostly rely on GPS-based
location data. GPS-based location analytics can provide us the most accurate
location for social media users.
IP-BASED
Public IP (Internet protocol) can be used to determine the location of Internet
users. A public IP address is an exclusive numerical address (like a home
address) assigned to a device connected to the Internet. Different regions in
the world are assigned a specific block of public IP addresses; hence, it can
be used to mine approximate geo-location of Internet users.
Powerful Intelligence
Simple maps have been widely used, but they are limited in providing
insightful details. Using sophisticated mapping techniques, such as
clustering, heat mapping, data aggregation (e.g., aggregating data to
regions), and color-coded mapping, can generate powerful business
intelligence (Hecht 2013).
Geo-Enrichment
Simple data maps can be enriched with customer data, including
demographic, consumer spending, lifestyle, and locations (Hecht 2013). For
example, where do my loyal customers spend most of their time?
Recommendation Purposes
Organizations can harvest location data to recommend products, services,
and social events to potential customers in real time as they approach certain
localities. For example, Tender recommends potential social relationships
based on the location of users.
Customer Segmentation
Social media location data can be used to segment customers based on their
geographic location. Tweepsmap (https://tweepsmap.com/), for example, can
be used to geo-locate your Twitter followers by country, state, or city.
Advertisement
Location-based advertisement allows targeted marketing and promotion
campaign mostly delivered through mobile devices to reach specific target
audiences.
Information Request
Based on their current location, customers can request a product, service, or
resource (e.g., the nearest coffee shop, restaurant, or parking lot).
Alerts
Location data can be used to send and receive alerts and notifications, such
as sales and promotion alerts traffic congestion alerts, speed limit warnings,
and storm warnings.
Navigation
Mobile- and GPS-based navigation services and apps assist us in finding
addresses. BE-ON-ROAD, for instance, is a free offline turn-by-turn GPS
navigation app for Android devices.
BACKGROUND
The Seoul Night Bus, also known as the “Owl Bus,” is the brand name of the
Seoul (South Korea) city’s intracity buses that run nine routes exclusively
from midnight to 5:00 a.m. Like an owl, animated in the dark with its
yellow-glowing eyes, the “Owl Bus” was born to make Seoul’s public
transportation service ceaseless, carrying the city’s late night commuters. As
the service is the first of its kind in Korea, policymakers struggled to shape
action plans in detail. Particularly, the biggest task was to address issues
such as selection of the routes, ensuring efficient operation and passengers’
safety and convenience. Location analytics and social media help Seoul
Metropolitan Government (SMG) to realize the “Owl Bus” project and
overcome these challenges.
THE PROBLEM
Since the subway line No. 1 opened in 1974 through to the transformation
reform carried out in 2004, the Seoul Metropolitan SMG has steadily
introduced measures to ensure greater convenience and better mobility of the
citizens. However, students and workers such as sanitary workers or small
business owners, who return home late night, found it hard to benefit from
the preexisting systems. Most of them suffer from the poor working
conditions and low salaries, yet they still had to pay the late-night extra
charge when taking taxis to return home.
Second issue was the growing inconvenience due to late-night taxis”
refusal of passengers and illegal operation. During late night and dawn
hours, there are far less available taxis than people who are trying to hail a
cab. Thus, illegal operations are prevalent by taxi drivers demanding extra
fares, causing serious inconvenience to citizens. Additionally, there are
practical limitations in controlling such irregularities. Firstly, there is a
shortage of police officers responsible for preventing such violations, and
even if the police catch an offender red-handed, it is difficult to obtain
evidence to prove the driver’s act of refusing passengers or demanding
illegal excess fares.
Third issue was related to the public-private consensus on the need for
new means of transportation to support urban dwellers” economic activities.
Seoul, transformed into a global city within just 50 years, is emerging as a
prime location of the global economy. As the city” industrial, economic and
cultural activities expand in size and scope, the citizens reached a consensus
on the need for a bus service that operates from midnight to dawn. It was
also considered that advanced nations such as Germany and the U.K. have
already run such services to promote the safety of the citizens and their
rights to mobility.
Private bus companies” selective operation on profitable routes was a
long-running concern for SMG. Thus, it shifted from private to quasi-public
bus operation system. In the new system, Seoul manages the bus routes and
revenues while the private companies operate buses.
THE SOLUTION
Test Operation of Night Bus at the Request of the Citizens: Since 2012,
the SMG has operated the 120 Dasan Call Center and the official blog to
better listen to the voices of the citizens, and developed various policy
measures based on the information collected through these channels. Along
the way, an opinion was received that the late night taxi service is not only
difficult to use but also imposes heavy financial burdens on users. An on-site
survey conducted for about six months from October 2012 found it
necessary to operate a late-night bus service. As a result, starting from April
19, 2013, the city government began operating two pilot routes exclusively
for an after-midnight service.
Role of location analytics and social media: Social media and
location analytics played a very important role in expanding the bus routes
and selection of “Owl Bus” brand name. For three months following the
launch of the test operation, the service was extremely well-received by
220,000 people, making it justifiable to raise the number of service routes.
The seven new lines were determined by taking into consideration the heavy
concentration of people on the move during late night hours. During the
initial stages of mapping out how to operate the Seoul Night Bus, the issue
of selecting bus routes emerged. The municipal government color-coded
regions by call volume based on the location data provided by a private
communication service provider, KT. Then, it analyzed the number of
passengers who get on and off at each bus stop in the heavy-call volume
regions and connected the dots to lead to the most pertinent routes. The data
was used to construct a radial-shape network linking outer districts of the
city with the hub areas such as Jongno and Gwanghwamun.
With news regarding the Late Bus spreading over SNS channels,
citizens voluntarily suggested to name the late-night bus. Thus, the city
government invited public ideas for the naming of the service and, as a
result, the brand name “Owl Bus” and “N (Late Night),” and the character
that portrays an owl operating a bus were selected. These symbols have been
used to mark bus stop signs, bus route map and numbers and distinguish the
late-night buses from ordinary ones. With the letter “N” in the bus number,
the service began its full operation on September 16, 2014.
RESULTS
Real-time operation information: The service provides citizens with real-
time operation information. Anyone who wants to take the “Owl Bus” can
check the arrival time and location of the bus stop in advance through the
website or smartphone apps. Meantime, given that the service operates late
night, safety measures were critical to protect citizens. Besides the protective
partition and speeding prevention device, it was made mandatory to inspect
the vehicle before driving. The drivers with proven qualifications are also
well remunerated so that they do not have to take on other vocational
activities during the daytime hours and can fully concentrate during night
time driving.
Safe and Affordable Means of Transportation for Citizens: The
numbers of “Owl Bus” passengers are on the constant rise. A total of
1,735,000 people have taken the buses from September 2009 to June 2013,
making the daily average passengers stand at around 7,000. As for economic
aspects, passengers are expected to save approximately KRW 6,000 as the
“Owl Bus” charges KRW 1,850 per trip while the average taxi fare in the
same timeframe costs KRW 8,000. Given that the most of the passengers are
students, self-employed small business owners or workers, the service is
expected to help stabilize their household finances.
Meantime, most passengers are concentrated in the timeframe from
midnight to 03:00, when students and workers return home completing their
after-school self-study and night duties. As the unfrequented time tends to
leave them more vulnerable, the “Owl Bus” is considered to help them move
more safely. Notably, the “Safe returning-home service” provided in
cooperation with the nearby police stations reinforce the safety.
Income redistribution for the economically disadvantaged: Before
the operation of the “Owl Bus,” one had to pay up to tens of thousands of
won to move from the city center to a residential district outside the city.
However, they now can complete their journey with just 1,850 won. As the
savings will lead to higher disposable incomes, income redistribution effects
are expected, too. As of 2013, the SMG estimates nearly KRW 14.1 billion
worth of economic benefits have been redistributed.
Distribution of the manual for other local governments to
benchmark: As residents of other cities express their interest in the “Owl
Bus,” through SNS channels, local governments and research institutes have
inquired about the process in the run-up to the introduction and requested
lectures on the “Owl Bus.” With many metropolitan governments expressing
their interest, the Busan Metropolitan Government has already begun
operating the late night service by extending the operation hours of existing
intracity buses and other cities such as Ulsan and Daejun consider
introducing it, too.
RESOURCES
Budget: To finance the operation of the “Owl Bus,” budget provision was
needed to pay for the labor costs and the installation of safety facilities such
as protective walls for drivers and a speeding prevention system. However,
these expenses were covered by the joint management funds for the shift
from private to quasi-public bus operation. Consequently, additional costs
were not incurred.
Technology: Information systems connected inside the vehicles such
as the Bus Management System, the Bus Information Unit and Bus
Information Tool enable comprehensive control of the bus operations, and
efficient adjustment of intervals while providing users and drivers with real
time operation information.
Human resources: The “Owl Bus was introduced without incurring
additional costs, and increased operation revenues too. The allocated
resources are 45 vehicles and a total of 54 workers; 36 for driving and 18 for
management.
Source: Bus Policy Department, the Seoul Metropolitan Government,
South Korea.
In this tutorial, we choose the “from this computer” and click “Browse
File” to upload the data. Locate the data you want to open and click the
“Next” button.
Step 3: Next, choose the format (i.e., comma separated, tab, colon, or
other type) of data being uploaded (in this case KML). Leave the other
options on their default settings and click the “Next” button.
Step 4: After the data is loaded, make sure that the correct row is
selected for the column names (which is normally row 1) and click “Next.”
Step 5: Once the data is imported, provide the following details and
click “Finish.”
Table—Provide a meaningful table name.
Allow export—If you check this, other users will be able to export your
data into a CSV file.
Attribute data to—Here you can write a message that will be displayed
when people view or use your data.
Attribution page link—Provide the attribution page URL or link, if any.
Description—Provide a meaningful description here that may help you
remember what the data is about.
Step 6: Now your data is uploaded into the Fusion Table and you are
ready to process, visualize, and share it.
Step 7: Fusion Tables auto-detect location data and display a tab called
“Map of <location column name>.” In this case, the “Map” tab is titled
“Map of geometry.” Click on “Map of geometry” to see a map of the police
stations (Screenshot 18).
1. Click on the “Rows” tab and find the column name that has the location
data and click on the downward pointing arrow.
2. Next, click on “Change.”
3. On the page that opens up, choose “Location” for the type and then
click on the “Save” button.
➢ Make sure that you are on the “Map” tab. Click “Tools→Change
map→Change feature styles.”
➢ Click on the “Marker” icon in the left panel and “Fixed” in the
right panel.
➢ Choose a different marker style from the dropdown menu and
click “Save.”
➢ You can also assign different marker icons to different types of
variables by using the “Bucket” option. For example, police
stations in different regions can be marked with different icons.
➢ Make sure that you are on the “Map” tab. Click on the “Filters”
button available at the left upper side of the map.
➢ Select a filter that you want to apply from the dropdown list (e.g.,
we chose “Region”).
After applying the filter, you will be offered all the distinct values for
regions (in this case, four regions are displayed). We choose to display
police stations from only one region (i.e., Northern Metro). Now only data
about police stations from Northern Metro is displayed.
Customize the info window—the default information window that
appears when you click on a red dot only uses the first ten columns from the
data table, but you can customize which data appears and how it is
displayed.
➢ Make sure that you are on the “Map” tab. Click on the
“Tools→Change map,” then click the “Change info window”
button.
➢ Click on the checkboxes to add or remove information from the
automatic info window template.
➢ You can also customize the overall style and content of the info
window template by clicking the “Custom” tab. Once done, click
on the “Save” button.
Adding charts—Fusion Tables lets you add charts to your data so that
you compare and contrast multiple values at a glance.
➢ To add a chart, click on the red plus (+) sign and then click on
“Add Chart” from the dropdown menu.
➢ Once a chart is added, you can choose different variables (e.g.,
continuous or categorical) to the chart depending on the type of
chart you selected (e.g., pie chart, bar graph, line chart, or
network chart). A chart type can be changed from the left panel.
➢ Once you selected the right type of chart, click on the “Done”
button in the upper right-hand corner (Screenshot 19).
Screenshot 19. Configuring charts
Sharing your data—One of the main reasons you are using Fusion
Tables is to make your data available for other to see and download. To share
your map, use the following steps.
➢ Make sure that you are on the “Map” tab. Click on the “Tools”
menu and then click on “Publish.”
➢ You can either share it with a limited number of people through e-
mail, or you can make it available over the Internet for everyone
to see. In this exercise, we will make it available to the public.
➢ Click on the “Change” option under “Who has access.” A new
window will appear. Select the “public on the web” option and
then click “Save.”
➢ Next, you will be provided with a link and an HTML code for
sharing your data. Copy it and click “Done.” The code and the
link can be embedded into your blog, website, or social media
platforms. You can always get the link and code by clicking
“Tools” and then “Publish.”
➢ In a similar way, the charts you have created can be shared. Note
that to share a chart, you must be at the “Chart” tab and then click
“Tools→Publish.” You will be provided with a code and link to
share.
Review Questions
S EARCH ENGINES are the gateways to social media and help users
search for and find information. To be more precise, a search engine is an
Internet service or software designed to search information on the web that
corresponds to a request (e.g., keywords) specified by the user. Considering
that there are billions of websites over the web, search engines play a crucial
role in helping us find the right information in a limited amount of time.
Before shifting our focus to search engines analytics, let’s understand
different types of search engines.
CRAWLER-BASED
As the name suggests, crawler-based search engines create their databases or
lists automatically, without any human intervention. Examples of crawler-
based search engine are Google.com and Bing.com. Crawler-based search
engines are widely used to find and access content over the Internet. They
operate in three steps: 1) web crawling, 2) indexing, and 3) searching.
Web crawling—Search engines start by collecting and storing
information about web pages. This mechanism is termed web crawling. A
web crawler (also known as web spider or bot) is a computer program or
software specifically designed to collect and store data about websites for
indexing.
Indexing—Indexing helps classify a website correctly for searching
purposes. The data crawled or extracted is then indexed and stored in a
database for quick access. Every search engine may follow different
techniques for indexing web page data. Common indexing techniques
include storing meta tags (which are used in the header of a web page and
provide descriptions of the website) and keywords related to a website.
Searching—Searching is the final step in search engine operations.
When a user requests specific information by entering keywords in a search
engine, the search engine queries the index and provides a list of the most
relevant web pages by matching it with the indexed keywords. However, it
may not be that simple; search engines use a variety of factors to rank and
provide a list of matching websites.
A takeaway here is that in order to achieve good search results an
organization must place keywords in section titles, images, and in the
general content of its website. A keyword density of 5–8 percent (i.e., five to
eight keywords per one hundred words) is an optimal number. Having
important keywords embedded in a website enables a search engine robot to
evaluate the website as being the most suitable site for the searched word.
However, if one repeatedly uses the same keywords or definitions in page
content, it may be perceived by a robot to be spamming (Yalçin and Köse
2010). Research has shown that the position of key words in a website, as
well as their duplication, layout, and combination, impact web page
visibility in a search engine, (Zhang and Dimitroff 2005) which can be
improved by increasing the frequency of keywords in the title, the full text,
and in both the title and full-text. In conjunction with key words, the overall
design of a website is an important factor that must be taken into
consideration when discussing search engine optimization. For example,
flash animations, while aesthetically appealing, can negatively impact the
SEO evaluation results because they cannot be indexed as easily by bots as
more simply structured HTML content (Yalçin and Köse 2010). For a
corporation to better understand its Internet presence, its website statistics
should also be checked on a regular basis so as to understand both how users
access and utilize the site and also what impact site changes may have on
these behaviors.
DIRECTORIES
The listings in directories are manually compiled and created by human
editors. People who want to be listed in a directory submit an address, title,
and brief description of their website, which is then reviewed by the editor
and included in it. Some good examples of human-created directories are
Yahoo Directory, Open Directory, and LookSmart.
METASEARCH ENGINES
Metasearch engines compiles and display results from other search engines.
When a user enters a query, the metasearch engine submits the query to
several individual search engines, and results returned from all the search
engines are integrated, ranked, and displayed to the user. Examples of meta–
search engines include Metacrawler, Mamma, and Dogpile. By integrating
results from several search engines, metasearch engines are capable of
handling large amounts of data and can help us save time by focusing on one
search engine.
Based on their scope, search engines can be divided into two types: 1)
local and 2) global.
By using, for example, Open SEO Stats (an extension for Google
Chrome available at: http://pagerank.chromefans.org/), users can be
determine the ranking of a website based on Google PageRank. Google
PageRank uses a scale of 0 to 10, indicating the importance that the Google
search engine allocates to the page. In addition to page ranking, Open SEO
Stats also provides information about website traffic, hyperlink status, and
speed of the page, among other things.
SEARCH TREND ANALYTICS
Search engine trends analytics deals with analyzing and understanding the
keywords people use in a search engine. Search engine data are gateways
into the minds of customers. Through search engines, customers search for
what they want, thus search trend analysis can provide value information to
the social marketers.
When it comes to trends analytics, Google Trends
(http://www.google.com/trends/) is one of the most convenient and
comprehensive search engine trend analysis tools. Google trends use
massive amounts of search engine data to analyze the world’s interests and
predict trends. In the financial sector, Google Trends data, for example, has
been used to detect “early warning signs” of stock market moves (Preis,
Moat et al. 2013). In the health sector, Google Trends data has helped
determine world flu epidemics (Ginsberg, Mohebbi et al. 2009). Engineers at
Google.org, for instance, using Google Trends data, found a strong
correlation among the searches for flu-related topics and the numbers of
actual flu cases circulating in different countries and regions around the
world (Ginsberg, Mohebbi et al. 2009).
In this chapter, we use Google Trends for search engine analytics. From
a business perspective, Google Trends can help also answer a variety of
questions, including the following.
✓ Year in Search
✓ Trending Searches
✓ Trending on YouTube
✓ Top Charts
✓ Explore
✓ Subscription
Among them, the “Explore” option is the most important from the
search engine analytics perspective and we will look it in detail in this
chapter. But, first let’s briefly discuss the other analytic reports.
YEAR IN SEARCH
Year in Search is a short commercial video clip (with accompanying details
that can be further explored) that summarizes the world’s most popular
searches in a particular year. Currently, a year in search video is available for
the year 2014.
TRENDING SEARCHES
Trending Searches provides a list of top-ten searches on a daily basis for a
specific country. The search results for particular data are updated regularly.
TRENDING ON YOUTUBE
Like Trending Searches, Trending on YouTube provides a list of top-ten
videos on a daily basis for a specific country. The search results for
particular data are updated regularly.
TOP CHARTS
Top Charts displays a list of trending real-world people, places, and things
ranked in order of search interest in a particular year. With Top Charts, for
example, one can see a list of the top-ten most searched athletes, consumer
electronics, YouTube videos, topics, and global news, among other things.
Top Charts depends on Knowledge Graph technology to provide the
rankings (Knowledge Graph is Google’s knowledge base that understands
facts about real-world things (e.g., people, places and things) and their
connections. Knowledge Graph is used to enhance users’ search experiences
by providing them structured and detailed information about the topic they
are searching for. More information on Knowledge Graph can be found here:
http://www.google.co.kr/insidesearch/features/search/knowledge.html). The
charts can be customized to show either global search trends or search trends
in a particular country. Historical search trends going back to the year 2001
are available.
EXPLORE
The Explore option is a very important resource in search engine analytics.
The Explore option lets you analyze search engine trends related one or
more search terms across time and location. Recall some of the questions we
mentioned earlier, such as, “How do people search for your brand?” “When
does interest spike in your products or services?” “Which keywords drive
more traffic?” “Which regions are interested in your brand?” The Explore
option can help you answer these questions. Here is how to start using the
Explore option.
Step 1: Open Google Trends: http://www.google.com/trends/.
Step 2: Click on the “Trends” option in the upper left-hand corner.
Next, from the dropdown menu, select “Explore.”
Step 3: Next, click on “Add Terms” to enter the search terms for what
you want to analyze. Repeat this process until you have entered all the
desired terms. In this case, we entered three terms: “iPhone 4,” “Galaxy S4,”
and “LG Optimus.” The results are grouped into three categories: 1) interests
over time, 2) regional interests, and 3) related searches. Below, we discuss
each of the categories in detail.
Screenshot 20. Interest in iPhone 4, Galaxy S4, and LG Optimus over time
REGIONAL INTERESTS
The “Regional Interests” section shows interest in the search terms with
respect to geography (Screenshot 20). Note that for each search term,
regional interest is shown in a separate window. In the screenshot below, we
are looking at the regional interest in the “iPhone 4” term. You can choose
the “Galaxy S4” term by clicking over it. You can also switch between
region and city view by the clicking the appropriate option in the top right-
hand corner. From the results it is clear that top cities interested in the
iPhone 4 are Ho Chi Minh City, Hanoi, Bangkok, London, Singapore, and
Manila.
RELATED SEARCHES
The “Related Searches” section (available near the bottom of the page)
shows the popular search terms similar to your search terms. Using this
function, for example, you can find which topics will potentially drive more
traffic, “smartphone” or “Galaxy S4”? Knowing trending topics related to
our products/services can help us optimize a campaign.
Now that you understood the basic of Google Trends, let’s focus on
how to use the research function more effectively.
Review Questions