Show & Tell 9: ArcGIS Online

n this "Show & Tell" session, I'll show you some useful references to get you started learning about ArcGIS Online.

ARCGIS ONLINE

ARCGIS PLATFORM

There are three primary components of the ArcGIS Platform:

   - ArcGIS for Desktop (which you have been learning the last two weeks)

   - ArcGIS for Server (which you won't be learning at all this summer)

   - ArcGIS Online (which you will start learning now)

All three of these components work together to meet various mapping needs for visualization, editing, analysis, collaboration and spatial data management.

In LAD Module 8 you learned how to create map layouts as a way to share your maps and analysis and in the Show & Tell I showed you data driven pages. These are great ways to create map products for non-GIS users. These products are largely static maps, which are good, but with the web we can make them dynamic and share them with a variety of devices including smartphones.

ArcGIS Online is GIS on the cloud. Over the next few days you will learn how to publish your map data from ArcGIS for Desktop to ArcGIS Online. You will learn how to make web maps and mapping applications using simple online tools.

INTRODUCTION TO ARCGIS ONLINE

VIDEO #1


I have a couple of videos I'd like you to watch to get an idea of what ArcGIS can do.


First, a short (2 minutes) video that provides an overview of ArcGIS Online.

Here's the link to ArcGIS Online Overview.

VIDEO #2

This second video will go more in depth into how ArcGIS for Desktop and ArcGIS Online work together.

Watch the first 17 minutes of this video to see how your map data from Desktop can be published as map services and then used to make web maps.

Here's the link to The ArcGIS Platform.

TUTORIAL

After you've watched the two videos, I'd like you to start the ArcGIS Online tutorial. You'll learn the basics of working with map services and web maps. The examples are all from Big Island, I think you'll find it interesting.

Here's the link to the ArcGIS Online Tutorial.

You'll need to enter your first and last name along with your email to get an account. Work through this tutorial for the next couple of days.

Challenge 8

Module 8 covers layouts and making presentation maps. In this "Challenge" session, I'm asking you to continue applying what you learned in LAD Module 8 and earlier Challenges.

The data is included in the Challenge8 zip file which you can download and unzip. If you already downloaded this data for "Show & Tell" you don't need to download it again.

CHALLENGE

In this Challenge you will need to use the precinct data, table joins and/or relates, as well as Data Driven Pages to answer these questions and make a map.

1) Which precinct in Maui has the highest percentage of registered voters compared to VAP?

     DP:   ___________________

     RV/VAP percentage:   __________________

2) Which precinct in Maui has the lowest percentage of registered voters compared to VAP?

     DP:   ___________________

     RV/VAP percentage:   __________________

3) Make a map that shows the precincts colored based on the RV/VAP percentage. Also show the census block boundaries. Label each precinct with its DP number and its RV/VAP percentage.

4) Now make a layout and add a title, legend, scalebar and credits. Also add a location map that shows where the precinct is within Maui County.

5) Create Data Driven Pages and add some Dynamic Text boxes to your layout.

Show & Tell for Module 8: Election Data

In this "Show & Tell" session, I'll show you some useful things that were not included in  LAD module 8.

If you'd like you can try these yourself. The data is included in the Challenge8 zip file which you can download and unzip. Here are the notes to re-create what I show you.

ELECTION DATA

PRECINCTS

The State of Hawaii Office of Elections works with County Clerks to conduct elections in Hawaii. These elections are for Federal, State and County offices as well as other issues that voters decide. Hawaii is divided into precincts to facilitate managing an election and reporting the results. Most precincts have a polling place where voters come on election day to cast their ballot. Schools are often used as polling places which is one of the reasons you get a holiday on election day. Precincts with few voters don't have a polling place and instead vote an absentee ballot.

Here is a map of the precincts in Maui County.

Every precinct has a unique identifier, called a DP. For example, the area around Hana is precinct 13-03. Let's look at the feature table.

You can see that each feature has its DP designation. "PollingPlace" is the name of the place where ballots are cast on election day. "BallotType" shows the combination of Federal Congress (US2), State House (H08) and State Senate (S05). Maui does not delineate County Council districts based on population, so every ballot lists all of the County Council races, thus all end in "MAU". Hawaii and Honolulu do have population based Council districts so their BallotType would show those Council numbers.

REGISTERED VOTERS

Voters are assigned to a specific precinct depending on where they live. Some precincts have a large percentage of voting age population registered to vote, others have less. The State Office of Elections wants to map which precincts have high percentages and which have low.

You've already seen how census block data records the total population and voting age population. From redistricting we know which census blocks make up which precincts so it is easy to summarize and obtain the total population and total voting age population in each precinct. These results have been combined with the number of registered voters in each precinct in this table:

You can see that the DP field is common in both tables so that is a good field for establishing joins and relates. The fields are pretty self-explanatory. "Pop2010" is the total population from the 2010 census. "VAP_2010" is the total voting age population (age 18 years and older) from the 2010 census. "RV_20130513" is the count of registered voters on May 13, 2013.

DATA DRIVEN PAGES (DDP)

Here is a handy way to navigate between the different precincts using Data Driven Pages (DDP). The DDP toolbar looks like this:

At first most of the buttons are not active. Click the button on the left of the toolbar to set up DDP.

Fill out the Definition page as shown here. Basically you are saying to use the features in the "precincts_Maui" layer to define a page, one page for each feature. There are other options but let's keep it simple for now. Click the "OK" button.

You'll see that your map has panned and zoomed automatically to the first page based on the first feature, precinct 08-01.

You can click the right arrow...

...to advance to the next page. This page is based on precinct 08-02 so it again automatically pans and zooms such that 08-02 is in the center of the page and fills most of the page.

This is a very handy way to move between features, just configure DDP using that feature class.

DDP AND LAYOUTS

Another huge benefit of DDP is with layouts. In LAD module 8 you learned about layouts for making presentation maps. You can design layouts that will change page to page using DDP. You design your layout like you learned already, but you can also insert special Dynamic Text boxes that will display attributes for the current DDP page.

You insert a Dynamic Text box based on a Data Driven Page Attribute. Here's an example:

You can see that I have inserted five special text boxes, one a title box that shows the DP of the current page. The other four show four different values from the table for that feature. This is a very powerful tool for making presentation maps and map books.

You will need to use this precinct data for Challenge 8.

Challenge 7

Module 7 covers ModelBuilder and using and creating tools. It is valuable to know and we may use one or more models in our project, but in this "Challenge" session, I'm asking you to continue applying what you learned in LAD Module 6 and in Show & Tell 6 - Safe Relationships.

The data is included in the Challenge7 zip file which you can download and unzip. If you already downloaded this data for "Show & Tell" you don't need to download it again.

CHALLENGE

In this Challenge you will need to use the parcel data and table joins and/or relates to answer these questions.

1) Tell me about TMK 239001086.

     Owner(s):  ________________________________________________

     Land value:  _______________________

     Building value:  ______________________

     Site address:  _______________________________________________

     Mailing address:  ____________________________________________

2) Tell me about the parcel with the highest building value.

     TMK:  ______________________

     Owner(s):  ________________________________________________

     Land value:  _______________________

     Building value:  _______________________

     Site address:  _______________________________________________

     Mailing address:  ____________________________________________

3) Tell me about the parcels owned by "KCOM CORP".

     How many parcels?  ________

     Total land value:  _____________________

     Total building value:  _____________________

4) Tell me about the TMK with the greatest number of TMKADDRESS site addresses.

     Which TMK?  ____________________

     How many TMKADDRESS site addresses?  _____________

     How many TMKGEOADDR for this TMK?  _____________

5) Tell me about mailing addresses.

     Which state (other than Hawaii) gets the most tax bills delivered?  __________

                                                                                    How many?  _________

     How many tax bills are delivered to Alaska?  ________

6) Add the census blocks from Challenge 6 to your map.

     How well do the census block boundaries line up with the parcel boundaries?

     ______________________________________________________________

     Do you see any problem with assigning each TMK to its correct census block?

     ______________________________________________________________

Show & Tell for Module 7: Parcel Data

In this "Show & Tell" session, I'll show you some useful things that were not included in  LAD module 7.

If you'd like you can try these yourself. The data is included in the Challenge7 zip file which you can download and unzip. Here are the notes to re-create what I show you.

PARCEL  DATA

One of the functions of county government is to manage land ownership and to collect property taxes. Each of the four counties in Hawaii has a Real Property group that manages the data necessary to provide this function. Parcel data will be important in our project as a reference layer for both owner names and addresses.

In this example I have selected a small set of parcels in Kihei, Maui. The data is from 2006 which will work for our example. In the project you will use current parcel data. Let's start with the map of parcel features.

I have drawn the parcel features (polygons) with no color inside and a purple outline. Let's look at the parcel features table:

You can see the TMK field. Each parcel feature has a unique TMK (Tax Map Key) that identifies that parcel and can be used to relate to other data tables.

The OWNER field lists an owner of the parcel. As you saw in our previous Show & Tell on table joins and relates, one parcel can have multiple owners. We'll look at the owner database next, but for now, note that any OWNER value that ends in "/etal" (lower case letters) means that there are two or more actual owners.

OWNERS (FEE)

Let's look at the OWNER table now.

This is data for all of the owners. Note that while there were 1,447 parcel records, there are 4,633 owner records. You can see that parcel 222023001 has two owners, Maybeline and Martin. Note that in the parcel table above you only see Maybeline's name along with "/etal". Again, the "/etal" indicates that you need to refer to the owner table to see all the owner names.

The other field here is TMKFULL. Note that the first nine digits are the same as the TMK. The last four digits (sometimes called CPRs or HPRs) are used to identify units within the parcel. For example, a condo parcel might have several dozen units, in which case the last four digits will be 0000, 0001, 0002, 0003 etc. In the table above there is only a single unit for TMK 222023001 with two owners so the last four digits are 0000.

Scrolling further down in the table, here is an example of records with different CPRs.

Note that the TMK is the same, 238077001, for all the records. On the map this is a single parcel, a single map feature. Looking at CPR 0000 we can see that within this parcel is the "Kihei Villages Phase I" project. Then you can see the owners of the different units. Note that some units, like CPR 0001, have only one owner. Other units, like CPR 0003, has two owners.

OWNERS (LEASEHOLD)

All of the owners in the above table are Fee title owners, meaning they own the land. There is a separate table for those owners who only hold the LEASEHOLD interest.

Most owners are fee owners in this area, there are only 28 leasehold owners in this area. Each record has a TMKFULL value which can be used to relate different tables. Note that a parcel with leasehold owners will also have one or more records for fee owners.

VALUE

Each parcel has an assessed value for the land and for the building(s). The VALUES table contains this information.

In addition to the land and building values, there is also a field HOMEOWNER that indicates whether the owner lives on the property. Let's scroll down and look at the same CPR records in this table.

The CPR 0000 record is the master record for the project and shows the value of the land held in common. The individual CPR records then show the amount of land value apportioned to each unit and the building value for each unit.

If you look back at the owner table above, note that CPR 0003 has two owners, however in this value table, CPR 0003 has only one record. The two owners jointly own this same unit.

ADDRESSES (SITE)

Each parcel has a site address, or sometimes many addresses, for example a condo project. The site address is the address where the parcel or unit is located.

There are two addresses shown in the table - the TMKADDRESS which will include the unit number (if any), and the TMKGEOADDR which contains just the address part which is sometimes used for a process called geocoding. Let's scroll down to the same CPR records.

You can see the different unit numbers in TMKADDRESS that have been removed from TMKGEOADDR.

ADDRESSES (MAILING)

There is another table of addresses - mailing addresses. These are the addresses where the tax bill is mailed to. Sometimes it is the same as the site address and sometimes it is different.

You can see that, for example, the tax bill for 222023001 is mailed to Pittsburg, California. Let's look at the rest of the table.

You can also see that the tax bill for 222023002 is mailed to an address on Maui, but not to the site address.

This type of information will be very helpful to us in our project where we are trying to locate voter addresses.

PARCEL GEOGRAPHY AND OTHER GEOGRAPHY

Just as with the census blocks, when you zoom in close you'll start to notice that the parcel boundaries don't line up perfectly with the basemap features.

This is 2006 data and since then Maui County Real Property has been working to make their parcels more accurate spatially. Sometimes the basemap is inaccurate. Sometimes it's both. This will be an issue we have to deal with in our project.

You will need to use this parcel data for Challenge 7.

Challenge 6

In this "Challenge" session, I'm asking you to apply what you learned in LAD Module 6 and in both Show & Tell 6 - Safe Relationships and Census Data.

The data is included in the Challenge6 zip file which you can download and unzip. If you already downloaded this data for "Show & Tell" you don't need to download it again.

CHALLENGE

In this Challenge you will need to use the census data and table joins and/or relates to answer these questions.

1) What is the total 2010 census population for the State of Hawaii?

     Total population = ______________

2) Which census block in the State of Hawaii has the largest total population?

     Population = ______________

     GEOID10 = ________________________

     Which island is it on?   ____________________

3) Which census block in Maui County has the largest total population?

     Population = ______________

     GEOID10 = ________________________

     Where is it?   ______________________________________

4) Which census block in Hawaii County has the largest total population?

     Population = ______________

     GEOID10 = ________________________

     Where is it?   ______________________________________

5) What is the total population for each county (hint: use Summarize)?

     Hawaii County      ____________________

     Maui County          ____________________

     Kalawao County   _____________________

     Honolulu County   _____________________

     Kauai County        _____________________

6) How many census blocks in the State of Hawaii have population but no one under age 18?

     number of blocks   __________

7) What percent of the total state population lives in census blocks with a dominant race category:

     _____%   W   White

     _____%   B    Black

     _____%   I     American Indian or Alaska Native

     _____%   A    Asian

     _____%   H    Hispanic

     _____%   M   miscellaneous, none of the above are a majority

8) Prepare a map of census block group 150090307074 that shows a pie chart for each census block showing the population breakdown by race. I showed you how to do this in Show & Tell for LAD modules 1-4.

Show & Tell for Module 6: Census Data

In this "Show & Tell" session, I'll show you some useful things that were not included in  LAD module 6. This blog covers census data. Another blog covers table joins and relates.

If you'd like you can try these yourself. The data is included in the Challenge6 zip file which you can download and unzip. Here are the notes to re-create what I show you.

CENSUS DATA

Every ten years the United States Census Bureau conducts a census of the United States for redistricting purposes. The United States population is continually growing and moving. Here you can see how the weighted center of population has moved westward with each decennial census.

The first census was conducted in 1790, shortly after the Constitution was ratified. The most recent decennial census was in 2010. It's interesting to see how we have grown.

Here you can see how the total US population has grown from about 4 million in 1790 to more than 300 million in 2010. New York has always been the most populated city.

The United States census is broken down by several different geographies. For our project we'll be using the following hierarchical breakdown:

     Country - State - County - Tract - Block Group - Block

Our country is composed of states, states are composed of counties, counties are composed of tracts, tracts are composed of block groups, and block groups are composed of blocks - census blocks. You're familiar with the first three, maybe not the last three. They are special geographies used for census purposes.

TRACTS

To help you understand these last three, let's look at Maui County.

The gray lines delineate the census tracts in Maui County. Including Kalaupapa, there are 36 census tracts in Maui County. I have selected a tract in the Kihei area to look at more closely.

As you can see here, census tracts can cover both land and ocean. Every census tract has a unique ID. In the Challenge 6 dataset this field is called "GEOID10".  It is composed of three parts:

     - a unique code for the State of Hawaii (15)

     - a unique code for Maui County (009)

     - a unique code for the tract (030707)

The first two are combined together to create what's called a FIPS code. Every county in the United States has a unique FIPS code. Maui County is 15009.

All three are combined together to create the unique tract ID - 15009030707.

BLOCK GROUPS

Let's add in the next level, the block groups.

Block groups also can cover both land and ocean. You can see that this tract is divided into four block groups numbered 1 through 4. The unique block group code is added to the tract ID to create a unique Block Group ID. For example, the block group that covers land and ocean is block group 2, so it's unique block group ID is 150090307072.

BLOCKS

Let's add in the final level, census blocks.

Blocks generally do not cover both land and ocean. The pale orange lines are the block boundaries. You can see that one of them follows the coastline. There are too many to label them, so let's zoom in to block group 150090307074.

Now you can see the census blocks outlined in pale orange with a label showing their four digit block code. The first digit is the block group code followed by three digits that make a unique census block code. For example, the unique Block ID for 4001 is 150090307074001.  Here the Identify window for that block:

Every census block in the United States can be identified by it's 15 digit Block ID - in this table called GEOID10. The field TOTAL in this dataset is the 2010 Census total population count for this block - 806 total residents.

The census block is the smallest geography that the Census Bureau reports counts of population and households. More detailed demographic and economic data is not published at the block level to preserve privacy - instead being published at the block group or tract level. In our project we'll be using block level data. In your Challenge 6 dataset you'll see the table for census blocks for the entire State of Hawaii:

You can see the same fields as in the Identify window including TOTAL, the total population. 

VAP - VOTING AGE POPULATION

There is another table, this one showing the VAP population. This is the voting age population, meaning those 18 years and older.

The field TOTAL18 reports the VAP for each block. In LAD module 6 you learned how to join tables. You could use GEOID10 to join the VAP table to the blocks table.

RACE

And one more table, this one showing total population by race for each census block in the State of Hawaii:

The race fields are:

     WHITE

     BLACK

     AIAN        (American Indian or Alaska Native)

     ASIAN

     HPI           (Native Hawaiian or other Pacific Islander)

     OTHER

     MLTMN   (two or more of the above races)

There is also a field called MAJPOPTOT which identifies the dominant race in each block with a one letter code:

     W   White

     B    Black

     I     American Indian or Alaska Native

     A    Asian

     H    Hispanic

     M   miscellaneous, none of the above are a majority

     X    no population

Again, GEOID10 could be used to join this table to the blocks table.

CENSUS GEOGRAPHY AND OTHER GEOGRAPHY

Let's look again at the block map:

Now look at the census block outlines. These boundaries come from Census TIGER files that identify things like roads, streams, coastlines and other features that we can see on maps. Most census block boundaries follow some sort of natural or man-made features.

Look at Block 4003. This census block is actually the area inside Oluea Circle.  Note that the census geography, the census lines, do not match up with Oluea Circle as shown on the basemap. This does happen occasionally and is most often due to inaccuracies in the TIGER data. If you look at the other roads you'll see they match pretty well.

This problem, inaccurate census block boundaries, is one we will work on when we start our project.

You will need to use this census data for Challenge 6.