Python: Using Chrome Cookies & Scraping Links off a Web Page
Sometimes you need to scrape info off of a web page that sits behind a cookie login. It can be done with a combo of browsercookie3 and BeautifulSoup. Full example …
Automatic Pivot Table Refresh
A super annoying thing about Excel is that pivot tables require manual refreshes. This can easily be forgotten by a user that updates source data in a workbook and expects …
Parsing Repeated Data into Pivotable Format in Excel
Sometimes you gain access to structured data but it isn’t a straightforward Copy and Transpose job to get the data into a useful format for analysis or database ingestion. To …
Open Selected Links with Wait using Excel
If you have the need to open a bunch of links with Excel, just use this simple VBA macro to open them all in your default browser after they have …
Confluence Wiki Journey Rules Report
It is difficult to see rules within the Observepoint interface. Users are required to scroll through pages to get past ten validation rules. It’s not easy to verify what tags …
Python ETL for Observepoint Folders into PostgreSQL Database
Create the table: CREATE TABLE public.folders ( appsrunning INTEGER, appsinqueue INTEGER, fname text COLLATE pg_catalog."default", apprulefailures INTEGER, createdbyusername text COLLATE …
PostgreSQL to join Array column
This is the PostgreSQL to pull all the Rules and associated Journey information for a single journeyid. Learned how to join an array column (actions.rules) from Gary Seiling’s website. SELECT …
Development Tools
JSON Formatter: https://jsonformatter.curiousconcept.com/ This makes our JSON data retrieved from APIs super easy to read. Observepoint Javascript Regex Tester: http://regex.observepoint.com/ Helpful to test Javascript regex
Python Script to Pull JSON from API and Insert into DB
This script is used to populate the jctions table with the journeyids from the journeys table that we just loaded into the PostgreSQL Database. def loadActions(c): print(’:readActions() start’) cur = …
ETL for ObservePoint API Journey Rules
Create the table in our PostgreSQL database: CREATE TABLE public.rules ( fromtemplate BOOLEAN, rulename text COLLATE pg_catalog."default", checktimes INTEGER, accountid INTEGER, …