<oo>→<dh> Digital humanities

Course materials

XML

Relax NG

• Introduction to Relax NG
• Relax NG practice (self-test, with answers)
• Patterns, anti-patterns, and other Relax NG details
• Mixed content and empty elements in Relax NG
• Eric van der Vlist’s Relax NG is available at the Internet Archive and—although not reliably—at the author’s site.

Text Encoding Initiative (TEI)

• Lou Burnard’s What is the Text Encoding Initiative? How to add intelligent markup to digital resources
• TEI Guidelines (P5)
• TEI By Example offers a series of freely available online tutorials walking individuals through the different stages in marking up a document in TEI.
• Subscribe to the TEI-L discussion list

Regular expressions

• Introductory tutorials and practice
  • Regular expressions quick start (with links to other tutorials) at http://www.regular-expressions.info/
  • RegexOne introduction with simple, interactive exercises
  • Learn regular expressions with Software Carpentry
  • Regular expressions cheat sheet
• regexpal and ExtendsClass regex tester (on-line regular expression testers)
• Regex tips and Autotagging with regular expressions (at our sibling newtFire site)
• <xsl:analyze-string> tutorial
• Regex assignment #1
• Regex assignment #2
• Regex assignment #3

HTML

• HTML basics
• Server side includes (SSI)
• W3C markup validation service

Cascading style sheets (CSS)

• Introduction to Cascading style sheets (CSS)
• Using <span> and @class to style your HTML
• Layout and CSS:
  • Our Website layouts
  • Learn CSS Layout
  • A complete guide to Flexbox and The ultimate CSS flex cheatsheet (with animated diagrams!)
  • Josh W. Comeau’s Interactive guide to CSS grid
• Introduction to CSS animations
• Using Webfonts tutorial
• The CSS zen garden
• W3C CSS validation service (Jigsaw)
• A11y color contrast accessibility validator
• You can edit and develop CSS interactively in the browser. See Get Started With Viewing And Changing CSS for a brief tutorial. The tutorial is written for Chrome, but all of the major browsers have comparable developer tools.
• Color
  • Color-hex gives information about colors including color models (RGB,HSL,HSV and CMYK), Triadic colors, monochromatic colors and analogous colors calculated in color page.
  • Color Brewer provides attractive, curated color palettes, primarily for maps. See Rick Wicklin’s brief description to learn more about how to use it.
  • Rapid tables offers a variety of color-selection utilities
  • Coding colors easily using CSS3 hsl() notation

XPath

• What can XPath do for me?
• The XPath functions we use most
• XPath: Looking Stuff Up
  • Michael Kay, XSLT 2.0 and XPath 2.0. 4th Edition, available on line in the Pitt library system at http://site.ebrary.com/lib/pitt/detail.action?docID=10381092 (authentication required)
  • XPath and XQuery functions and operators 3.1 (W3C recommendation 21 March 2017)
  • XML Path Language (XPath) 3.1 (W3C recommendation 21 March 2017 )
  • Saxon XPath function documentation
  • W3Schools XSLT, XPath, and XQuery functions
  • devhints.io XPath cheat sheet
• Martin Honnen’s XML Workbench
• Fonto XPath playground
• XPath assignment #1
• XPath assignment #2
• XPath assignment #3
• XPath assignment #4

XSLT

• XSLT basics
• Our XSLT configuration in <oXygen/> describes how to set up the <oXygen/> XSLT debugging view to transform XML to HTML (and other output formats) using XSLT
• XSLT basics, part 2: variables, conditionals, keys, and push and pull
• User-defined functions (abridged version)
• What’s new in XSLT 3.0 and XPath 3.1? (in progress)
• The XSLT paradigm and Default template rules (slide sets from TEI XSLT workshop at Brown University)
• Thinking in algorithms (how to conceptualize an XSLT transformation before you begin to write the code)
• Developing an XSLT stylesheet (the workflow of writing XSLT)
• Using the XSLT identity transformation
• How to convert Bad Hamlet from XML to an HTML tables that counts the number of speeches in each act
• Modal XSLT
• Attribute Value Templates (AVTs)
• XSLT keys
• There are two basic ways to transform XML in <oXygen/> and save the output. We usually use the first one in our own work:
  • Saving generated output from XSLT transformations
  • Transforming XML with XSLT using transformation scenarios
• XSLT assignment #1
• XSLT assignment #2
• XSLT assignment #3
• XSLT assignment #4
• XSLT assignment #5
• (Not assigned in spring 2023: XSLT assignment #6)
• User-defined functions in XSLT: exercise 1

XQuery

• XQuery drive-by (general, stand-alone introduction to XQuery)
• Getting started with XQuery (brief introduction to using XQuery with eXist-db)
• XQuery Wikibook (general and eXist-db-specific XQuery documentation and examples)
• StylusStudio XQuery tutorials
• XML databases
  • eXist-db
    • eXist-db XML database and application platform
    • xst: Command-line interface for eXist-db
    • Language server and client for XQuery/eXistdb is a VSCode plugin, but the real-time synchronization between a local git repo and a running eXist-db instance is independent of VSCode. We use the plugin for synchronization even when we edit XQuery in <oXygen/>.
    • hoaXed wiki: Tutorial for creating eXist-db app
    • Using PHP to query the eXist XML database
  • BaseX
• See also the XML to network visualization by way of XQuery exercises in the Network analysis listings
• XQuery assignment #1
• XQuery assignment #2
• XQuery assignment #3

Schematron

• Introduction to Schematron
• Examples of Schematron from our projects
• Validating references with Schematron
  • Skyrim XML and Relax NG
  • Analysis
• Using Schematron in editing
• Andrew Sales’s curated list of Awesome Schematron tools and applications
• Mausotron-cli command-line Schematron validator
• Schematron assignment #1
• Schematron assignment #2

SVG

• w3schools introductory SVG tutorial (good, basic introduction; start here for a quick initial overview with brief examples of the most common features)
• Jakov Jenkov SVG tutorial (also introductory, but longer and with more detail than the preceding; start here for something more comprehensive)
• SVG cheat sheet (Washington State University)
• Viewbox tutorial: an introduction to the SVG coordinate space
• Creating stooge bar graph with XSLT:
  • Input XML (stooge.xml)
  • Commented XSLT (stooge-dynamic.xsl)
  • Output SVG (stooge-dynamic.svg)
• How to scale SVG (Amelia Bellamy-Royds’s tutorial about how scaling SVG doesn’t work like scaling other types of images).
• Katherine Kato’s SVG properties and CSS
• By Sara Soueidan:
  • Building better interfaces with SVG
  • Understanding SVG coordinate systems and transformations (Part 1) — The viewport, viewBox, and @preserveAspectRatio
  • Understanding SVG coordinate systems and transformations (Part 2) — The @transform attribute
  • Understanding SVG coordinate systems and transformations (Part 3) – Establishing new viewports
  • Making SVGs responsive with CSS
• Tutorial: Using XSLT to generate a bar graph
• Embedding SVG in XHTML
• Trigonometry refresher (in case you need to plot circular locations)
• SVG assignment #1
• SVG assignment #2
• SVG assignment #3
• (Not assigned in spring 2023: SVG assignment #4)

XSpec

XSpec is a unit test and behaviour-driven development (BDD) framework for XSLT, XQuery, and Schematron.

• XSpec main page
• XSpec wiki (official documentation)
• Amanda Galtman’s XSpectacles XSpec blog (code samples)
• Video tutorial about XSpec in <oXygen/> (see also official <oXygen/> XSpec documentation)

XProc 3.0

• XProc 3.0 main page (includes links to tutorials and other documentation)
• Tools
  • Our combined instructions for installing XProc and ixml processors
  • Achim Berndzen’s MorganaXProc-IIIse processor
  • Norm Tovey-Walsh’s XML Calabash 3 processor
• Our XProc basics
• Martin Kraetke’s XProc 3.0 Tutorial
• Erik Siegel’s XProc steps (3.0) is end-user-oriented documentation of the step library. See also Erik’s XProc 3.0 programmer reference (printed book)
• Wendell Piez’s XProc Zone
• Lesson plan: Invisible XML and XProc
• XProc assignment 1 (answers)

Invisible XML (ixml)

• The Invisible XML main page contains links to ixml documentation, tutorials, implementations, and references.
• Tools
  • Our combined instructions for installing ixml and XProc processors
  • Norm Tovey-Walsh’s NineML is a suite of ixml development and processing tools. The ixml processor tool is CoffeePot.
  • Gunther Rademacher’s Markup Blitz ixml processor
  • The primary purpose of Fredrik Öhrström’s xmq is to support an alternative (non-XML) syntax for XML documents, but xmq can also be used as a stand-alone ixml processor that creates XML output.
  • John Lumley’s jωiXML Invisible XML processor runs from an XSLT program executing in a browser. You can download and run it locally from the project GitHub repo or run it remotely at the workbench location
  • Steven Pemberton’s ixampl is a web-based Invisible XML parser
  • Alaine Couthures’s Grammix Demo is a web-based Invisible XML parser
• Invisible XML and ambiguity
• Lesson plan: Invisible XML and XProc
• Invisible XML assignment 1 (answers)

Scala and XML

• scala-xml (standard Scala XML library)
• XML processing in Scala (Dino Fancellu and William Narmontas, XML London 2014)
• Programming in Scala [chapter 26]—Working with XML (Tom van Eijk)
• XQS (XQuery for Scala; Dino fancellu)
• XML streaming library for Scala (xs4s; William Narmontas)

Visualization

• About visualization
  • Claus O. Wilke’s Fundamentals of data visualization
  • Twelve great books about data visualisation
  • Elijah Meeks’s D3 is not a data visualization library
  • Stephen Few’s Perceptual edge is primarily about business analytics, but the library and examples sections are applicable to humanities data.
  • Angela Zoss’s Introduction to data visualization
  • Yan Holtz’s and Conor Healy’s From data to viz
  • Peter Aldhous’s Data visualization: basic principles
  • addtwo digital’s Ninety-nine data viz rules and why it’s okay to break them
  • Dipanjan (DJ) Sarkar’s Effective visualization of multi-dimensional data: a hands-on approach
  • Andrew McNutt’s Surfacing visualization mirages (with Gordon Kindlmann and Michael Correll)
• Visualization galleries
  • Michael Bostock’s D3 visualization gallery
  • Wikipedia pages for diagrams and charts
  • Google graphs Chart gallery and Additional charts gallery
  • Jeffrey Heer, Michael Bostock, and Vadim Ogievetsky’s Tour through the visualization zoo
  • Severino Ribecca’s Data visualisation catalogue
  • Vega Example gallery
• Sample visualizations
  • Song modality: trends over time (Jacob Graham, Ted Kondrich, Vincent Marecic, Shannon Dunn, Bill Campbell; Pitt Greensburg student project, spring 2022)

JavaScript

• Our tutorials
  • Introduction to JavaScript
  • JavaScript piece by piece tutorial
• External tutorials, portals, and other resources
  • Mozilla development network JavaScript Guide and JavaScript reference
  • Marijn Haverbeke’s Eloquent JavaScript (open-access on-line textbook)
  • JavaScript Kit (a comprehensive resource for JavaScript tutorials, scripts, and more)
• Debugging tools
  • What are browser developer tools? (MDN)
  • Advanced guides to debugging in Chrome, Firefox, Edge, and Safari
• Sample code
  • Highlighting text sample (2009 Obama inaugural address)
  • Using JavaScript to change text (2012 US election results; illustrates JavaScript show/hide and innerHTML, as well as embedding SVG in XHTML)
  • JavaScript toggling with classList
  • Setting a value based on two dropdown lists
  • Show/hide and styling with JavaScript
• JavaScript assignment #1
• JavaScript assignment #2

Markdown

• GitHub three-minute guide to Mastering markdown
• John Gruber’s guide to Markdown syntax

Topic modeling

• Mallet (MAchine Learning for LanguagE Toolkit; software for topic modeling)
• Mining the Dispatch (Topic modeling in action)
• Getting Started with Topic Modeling and MALLET (Topic modeling tutorial)
• Ben Schmidt about topic modeling and similar technologies
  • Words alone: Dismantling topic models in the humanities (cautionary notes about the assumptions that underlie topic modeling, especially with diachronic data, and suggestions for using it more effectively)
  • Vector space models for the digital humanities (differently from topic modeling, this word-embedding model [WEM] represents relationships among words as a spatial analogy)

Network analysis

• Social network analysis: an introduction (includes David Krackhardt’s Kite network)
• Introduction to social network methods (Robert A. Hanneman and Mark Riddle)
• Networks demystified (Scott Weingart)
• An introduction to network analysis and Cytoscape for XML coders (Elisa Beshero-Bondar)
• The following two exercises, from our sibling newtFire course, illustrate how to use XQuery to extract data from your XML files and visualize it using Cytoscape:
  • XQuery to network
  • Graphing a network in Cytoscape
• Software: Cytoscape | Gephi | Pajek (pronounced PAH-yeck) | yEd

Geographic information systems (GIS)

• Keyhole Markup Language
  • Introduction to KML (our tutorial; see also our samples)
  • KML documentation (Google tutorial and reference)
  • Using XQuery and XSLT together to produce KML for mapping (from Elisa Beshero-Bondar’s Pitt-Greensburg DH course)
• Geocoding
  • Geocoding utilities at GPSVisualizer.com
  • GeoNames geographical database
• Datasets and maps
  • Natural Earth (public domain map dataset)
  • OpenStreetMap (collaborative project to create a free editable map of the world)
  • David Rumsey Map Collection
  • Perry-Castañeda Library map collection (University of Texas, Austin)
• GIS visualization software
  • Leaflet
  • QGIS (visualization, editing, and analysis of geographic information; see also QGIS Tutorials and Tips)
• Other resources
  • Comparison of geographic information systems software (article from Wikipedia)
  • e-Perimetron (e-journal on sciences and technologies affined to history of cartography and maps)

Natural language processing

• FreeLing: An open source suite of language analyzers
• Natural language tool kit (NLTK)
• Stanford NLP Group tools
• Yandex MyStem Russian NLP

Music

• Music analysis software
  • Software music analyzers (Mac OS)
  • Sonic Visualiser is a free, open source application for viewing and analysing the contents of music audio files. For tutorial guidance see especially Nicholas Cook and Daniel Leech-Wilkinson’s A musicologist’s guide to Sonic Visualiser.
  • Audacity is free, open source, cross-platform software for recording and editing sounds.
  • music21: a toolkit for computer-aided musicology
• Music encoding initiative (MEI)
  • MEI main project page
    • An introduction to MEI
    • MEI tutorials
  • Verovio (on-line tool to visualize MEI as musical score notation)
  • Metadata Editor and Repository for MEI Data (MerMEId)
  • MEI Score Editor (MEISE; Musical Note Editor)
  • Sample MEI projects

Unicode

• Unicode Consortium (includes code charts)
• Unicode checker (MacOS only; explore, analyze, and convert text among encodings)
• Unicode code converter (on-line, by Richard Ishida; see also his main page, character pickers, and other Unicode utilities)
• shapecatcher.com (draw a character and find it in the Unicode database)
• &what; (pronounced AmpWhat) character lookup utility