Page MenuHomePhabricator

FactsProject
ActivePublic

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

Phabricator ETL pipeline.

Recent Activity

Oct 29 2019

epriestley added a revision to T13279: Build Charting for Facts: D20879: Make the top-level burndown chart in "Maniphest > Reports" show open tasks, not total tasks.
Oct 29 2019, 8:46 PM · Plans, Facts

Sep 23 2019

epriestley added a revision to T13279: Build Charting for Facts: D20822: Unprototype "Facts" to clear Maniphest/chart fatals.
Sep 23 2019, 7:43 PM · Plans, Facts

Sep 20 2019

epriestley added a comment to T13279: Build Charting for Facts.

get rid of all obsolete / policy-violating stuff so no part of the Facts application is broken;

Sep 20 2019, 7:07 PM · Plans, Facts

Sep 18 2019

epriestley added a comment to T13279: Build Charting for Facts.

I believe charts in the UI now make physical sense. They aren't very fancy/polished yet, but everything I see on this install looks cohesive (no more overlapping negative areas, weird gaps, general nonsense, etc):

Sep 18 2019, 5:55 PM · Plans, Facts

Sep 17 2019

epriestley added a revision to T13279: Build Charting for Facts: D20819: Give "Burndown" charts a more straightforward definition and move all the event stuff into "Activity" charts.
Sep 17 2019, 8:25 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20818: Support explicit stacking configuration in stacked area charts.
Sep 17 2019, 7:30 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20817: Make various UX improvements to charts so they're closer to making visual sense.
Sep 17 2019, 4:26 PM · Plans, Facts

Sep 16 2019

epriestley added a revision to T13279: Build Charting for Facts: D20816: Track chart datapoints from their sources and provide a tabular view of chart data.
Sep 16 2019, 10:34 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

The "compose(...)" function won't select input values correctly if the first function in the chain isn't a data function. For example, if we compose:

Sep 16 2019, 9:32 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

D20814 combines nearby points so we don't have tons of overlapping tiny circles. For now, the grouping is just based on X-axis distance:

Sep 16 2019, 5:44 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20814: In stacked area charts, group nearby points so they don't overlap.
Sep 16 2019, 5:41 PM · Plans, Facts

Sep 13 2019

epriestley added a comment to T13279: Build Charting for Facts.

In stacked area charts, when we stack areas, we accumulate some error by stacking integer points on top of interpolated points.

Sep 13 2019, 5:12 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

if prototypes are disabled, some stuff is broken, particularly "View Chart".

Sep 13 2019, 4:45 PM · Plans, Facts

Jul 19 2019

epriestley added a comment to T13279: Build Charting for Facts.

Yeah, this is still in a transitional state, it's just been stalled for a bit (not blocked by anything, just other stuff has been getting attention). The two major issues I'm aware of right now are:

Jul 19 2019, 3:54 PM · Plans, Facts
Krinkle added a comment to T13279: Build Charting for Facts.

Not sure where to report this, but since a recent upgrade at Wikimedia, the new version of the Burnup Graph (now Reports: Burndown), has a tendency to go below zero. I'm aware the old version had inaccuracies so perhaps it was happening before as well but hidden (e.g. artificially replaced with zero or something like that).

Jul 19 2019, 3:32 PM · Plans, Facts

May 8 2019

epriestley added a revision to T13279: Build Charting for Facts: D20506: Stack chart functions in a more physical way.
May 8 2019, 7:54 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

The actual facts Maniphest currently generates need to be adjusted to properly support stacked-area-by-reason: currently, when a task is closed, we don't have enough data to figure out whether it should be removed from the "created into this project" area, the "reopened work" area, or the "moved work" area.

May 8 2019, 7:14 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20504: Store charts earlier and build them out a little later.
May 8 2019, 4:35 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20503: Automatically select the range for charts in a general way.
May 8 2019, 3:55 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20502: Wrap "<min, max>" chart domain pairs in an "Interval" class.
May 8 2019, 3:44 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20501: Provide chart function labels over the wire instead of making them up.
May 8 2019, 2:22 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20500: Label important data on charts.
May 8 2019, 1:55 PM · Plans, Facts

May 7 2019

epriestley added a comment to T13279: Build Charting for Facts.

One issue with model we're evolving toward is that if you view a chart in Klingon, then send the link to a user whose primary language is Kerbal, we'd prefer to relabel the chart in Kerbal, not restore serialized Klingon-language chart labels. That means label generation has to be at render time, not at chart construction time, and I'm serializing a data-structure which is slightly too low-level for common application cases.

May 7 2019, 2:07 PM · Plans, Facts

May 5 2019

epriestley added a comment to T13279: Build Charting for Facts.

This is a little ways out, but the actual facts Maniphest currently generates need to be adjusted to properly support stacked-area-by-reason: currently, when a task is closed, we don't have enough data to figure out whether it should be removed from the "created into this project" area, the "reopened work" area, or the "moved work" area. This is okay if we're summing the opens/closes but not precise enough if we're breaking them down.

May 5 2019, 2:48 PM · Plans, Facts

May 3 2019

epriestley added a revision to T13279: Build Charting for Facts: D20498: Roughly support stacked area charts.
May 3 2019, 10:44 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20497: Update D3 to the current version.
May 3 2019, 10:15 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20496: Consolidate burndown logic into a "BurndownChartEngine".
May 3 2019, 7:16 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20495: Add a "Reports" menu item to Projects.
May 3 2019, 6:54 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

Multiple Project Burnups Stacked in an Area Chart

May 3 2019, 2:56 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

See also PHI1226. An install has an environment where automatic rules (Herald/Owners) frequently trigger group reviewers (projects/packages), and some groups are not prompt about performing review.

May 3 2019, 2:35 PM · Plans, Facts

Apr 30 2019

epriestley added a comment to T13279: Build Charting for Facts.

I think a possible model for the UI is to have some base ChartConfigurationEngine, similar to SearchEngine, which defines a set of fields. Some fields would be common (e.g., all time-series charts can have time controls for domains).

Apr 30 2019, 10:31 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

The concrete use cases that are currently filed are:

Apr 30 2019, 10:23 PM · Plans, Facts
epriestley removed a parent task for T4171: Building reporting and data systems: T6821: Allow querying for open Maniphest tasks with an assignee set for ages ("cookie licking").
Apr 30 2019, 8:57 PM · Restricted Project, FreeBSD, Facts, Wikimedia
epriestley closed T4171: Building reporting and data systems as Resolved.

This is approximately coming into existence and this task no longer serves much of a purpose. See T13083 / T13279 for followups.

Apr 30 2019, 8:57 PM · Restricted Project, FreeBSD, Facts, Wikimedia
epriestley closed T1562: Build "Facts", an ETL pipeline and charting application as Resolved.

This now approximately exists and is no longer of much use as a standalone task. See T13279 and elsewhere for followups.

Apr 30 2019, 8:52 PM · Restricted Project, Wikimedia, Facts
epriestley closed T1562: Build "Facts", an ETL pipeline and charting application, a subtask of T4171: Building reporting and data systems, as Resolved.
Apr 30 2019, 8:52 PM · Restricted Project, FreeBSD, Facts, Wikimedia
epriestley closed T1562: Build "Facts", an ETL pipeline and charting application, a subtask of T6041: Metrics for Maniphest, as Resolved.
Apr 30 2019, 8:52 PM · Wikimedia, Facts, Maniphest
epriestley added a revision to T13279: Build Charting for Facts: D20489: Start the fact daemon in "bin/phd start".
Apr 30 2019, 4:52 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20487: Remove the legacy chart behavior from Maniphest.
Apr 30 2019, 3:56 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20486: Replace the chart in Maniphest Reports with a chart driven by Facts.
Apr 30 2019, 3:42 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20485: Add a rough "Chart" Dashboard Panel.
Apr 30 2019, 3:36 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20483: Render charts from storage instead of just one ad-hoc hard-coded chart.
Apr 30 2019, 3:31 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

hmmm

Apr 30 2019, 3:18 PM · Plans, Facts

Apr 18 2019

epriestley added a revision to T13279: Build Charting for Facts: D20452: Separate "accumulate(...)" from Fact functions.
Apr 18 2019, 9:07 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20449: Copy the "line-chart" behavior to "line-chart-legacy" to keep "Maniphest > Reports" working.
Apr 18 2019, 1:41 PM · Plans, Facts

Apr 17 2019

epriestley added a revision to T13279: Build Charting for Facts: D20446: Simplify implementation of "pure" Chart functions.
Apr 17 2019, 10:08 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20445: Make chart function argument parsing modular/flexible with 900 pages of error messages.
Apr 17 2019, 6:29 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20444: Add a "sin()" function to charts.
Apr 17 2019, 2:28 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20443: Add chart functions "x()" and "constant(3)".
Apr 17 2019, 2:04 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20442: Select the domain (X-axis range) for charts before pulling data.
Apr 17 2019, 1:09 PM · Plans, Facts