Scraper: project contact name/email

[benlk]

current-ltw-scraper/injection.js

Lines 44 to 53 in cbdbe25

	// project contact name (postmeta project-contact-name)
	// project contact email (postmeta project-contact-email)
	try {
	var raw_contact = $( value ).find( 'p.contact' ).text();
	// @todo remove preface text, split this into email and name
	row.project_contact_email = raw_contact;
	row.project_contact_name = raw_contact;
	} catch ( error ) {
	console.error( 'error processing project contact', error, value );
	}

• Remove label prefix from this text
• split into name and email fields

[benlk]

Formats seen:

Name(s), email
Name(s), email, email
Name(s), email, phone
Name(s), email, phone, phone extension
Name(s), email, phone phone extension
Name(s), job title, location, email, phone
lastname, firstname email, phone
, — for the entry titled "10708"

Contact: Laura, Frank laurafrank@rmpbs.org

Contact: Jordan Escobar, jescobar@valleypbs.org, 559-266-1800 ext 360
Contact: Jordan Escobar, jescobar@valleypbs.org, 559-266-1800, x360

Because there is not a consistent scheme here, they will have to edit contact info by hand for imports.

[benlk]

We could fix some of that on a per-case basis in the import, but that will take extra time.

[benlk]

2h tentatively approved to do:

• clean up of data using sed
• scrape names and emails into separate entries, using the code from the term scraper that looks backwards through the array

We're waiting for feedback on:

• should we make the phone number its own field, or just append it to the name field?

[benlk]

• Phone number is now its own field in the CSV project_contact_phone
• Replace in sed was too promiscuous; redid in injection.js for just the contact field.

output.csv.txt

This file should:

• should not contain the string XCOMMA
• contains the following columns: project_org | project_org_type | project_contact_name | project_contact_email | post_title | post_excerpt | post_content | project_link | project_category | post_thumbnail_image | post_thumbnail_caption | post_thumbnail_credit | post_embed | project_status | post_date | project_contact_phone
• does not have contact info for all projects; it wasn't supplied
• contains job titles in the project_contact_name field where those were given
• contains phone number extensions in the project_contact_phone field where those were given
• contains the description with HTML stripped as post_excerpt
• contains the description without HTML stripped as post_content