Page MenuHomePhabricator
Feed Advanced Search

Oct 29 2019

epriestley added a revision to T13279: Build Charting for Facts: D20879: Make the top-level burndown chart in "Maniphest > Reports" show open tasks, not total tasks.
Oct 29 2019, 8:46 PM · Plans, Facts

Sep 23 2019

epriestley added a revision to T13279: Build Charting for Facts: D20822: Unprototype "Facts" to clear Maniphest/chart fatals.
Sep 23 2019, 7:43 PM · Plans, Facts

Sep 20 2019

epriestley added a comment to T13279: Build Charting for Facts.

get rid of all obsolete / policy-violating stuff so no part of the Facts application is broken;

Sep 20 2019, 7:07 PM · Plans, Facts

Sep 18 2019

epriestley added a comment to T13279: Build Charting for Facts.

I believe charts in the UI now make physical sense. They aren't very fancy/polished yet, but everything I see on this install looks cohesive (no more overlapping negative areas, weird gaps, general nonsense, etc):

Sep 18 2019, 5:55 PM · Plans, Facts

Sep 17 2019

epriestley added a revision to T13279: Build Charting for Facts: D20819: Give "Burndown" charts a more straightforward definition and move all the event stuff into "Activity" charts.
Sep 17 2019, 8:25 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20818: Support explicit stacking configuration in stacked area charts.
Sep 17 2019, 7:30 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20817: Make various UX improvements to charts so they're closer to making visual sense.
Sep 17 2019, 4:26 PM · Plans, Facts

Sep 16 2019

epriestley added a revision to T13279: Build Charting for Facts: D20816: Track chart datapoints from their sources and provide a tabular view of chart data.
Sep 16 2019, 10:34 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

The "compose(...)" function won't select input values correctly if the first function in the chain isn't a data function. For example, if we compose:

Sep 16 2019, 9:32 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

D20814 combines nearby points so we don't have tons of overlapping tiny circles. For now, the grouping is just based on X-axis distance:

Sep 16 2019, 5:44 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20814: In stacked area charts, group nearby points so they don't overlap.
Sep 16 2019, 5:41 PM · Plans, Facts

Sep 13 2019

epriestley added a comment to T13279: Build Charting for Facts.

In stacked area charts, when we stack areas, we accumulate some error by stacking integer points on top of interpolated points.

Sep 13 2019, 5:12 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

if prototypes are disabled, some stuff is broken, particularly "View Chart".

Sep 13 2019, 4:45 PM · Plans, Facts

Jul 19 2019

epriestley added a comment to T13279: Build Charting for Facts.

Yeah, this is still in a transitional state, it's just been stalled for a bit (not blocked by anything, just other stuff has been getting attention). The two major issues I'm aware of right now are:

Jul 19 2019, 3:54 PM · Plans, Facts
Krinkle added a comment to T13279: Build Charting for Facts.

Not sure where to report this, but since a recent upgrade at Wikimedia, the new version of the Burnup Graph (now Reports: Burndown), has a tendency to go below zero. I'm aware the old version had inaccuracies so perhaps it was happening before as well but hidden (e.g. artificially replaced with zero or something like that).

Jul 19 2019, 3:32 PM · Plans, Facts

May 8 2019

epriestley added a revision to T13279: Build Charting for Facts: D20506: Stack chart functions in a more physical way.
May 8 2019, 7:54 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

The actual facts Maniphest currently generates need to be adjusted to properly support stacked-area-by-reason: currently, when a task is closed, we don't have enough data to figure out whether it should be removed from the "created into this project" area, the "reopened work" area, or the "moved work" area.

May 8 2019, 7:14 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20504: Store charts earlier and build them out a little later.
May 8 2019, 4:35 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20503: Automatically select the range for charts in a general way.
May 8 2019, 3:55 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20502: Wrap "<min, max>" chart domain pairs in an "Interval" class.
May 8 2019, 3:44 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20501: Provide chart function labels over the wire instead of making them up.
May 8 2019, 2:22 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20500: Label important data on charts.
May 8 2019, 1:55 PM · Plans, Facts

May 7 2019

epriestley added a comment to T13279: Build Charting for Facts.

One issue with model we're evolving toward is that if you view a chart in Klingon, then send the link to a user whose primary language is Kerbal, we'd prefer to relabel the chart in Kerbal, not restore serialized Klingon-language chart labels. That means label generation has to be at render time, not at chart construction time, and I'm serializing a data-structure which is slightly too low-level for common application cases.

May 7 2019, 2:07 PM · Plans, Facts

May 5 2019

epriestley added a comment to T13279: Build Charting for Facts.

This is a little ways out, but the actual facts Maniphest currently generates need to be adjusted to properly support stacked-area-by-reason: currently, when a task is closed, we don't have enough data to figure out whether it should be removed from the "created into this project" area, the "reopened work" area, or the "moved work" area. This is okay if we're summing the opens/closes but not precise enough if we're breaking them down.

May 5 2019, 2:48 PM · Plans, Facts

May 3 2019

epriestley added a revision to T13279: Build Charting for Facts: D20498: Roughly support stacked area charts.
May 3 2019, 10:44 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20497: Update D3 to the current version.
May 3 2019, 10:15 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20496: Consolidate burndown logic into a "BurndownChartEngine".
May 3 2019, 7:16 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20495: Add a "Reports" menu item to Projects.
May 3 2019, 6:54 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

Multiple Project Burnups Stacked in an Area Chart

May 3 2019, 2:56 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

See also PHI1226. An install has an environment where automatic rules (Herald/Owners) frequently trigger group reviewers (projects/packages), and some groups are not prompt about performing review.

May 3 2019, 2:35 PM · Plans, Facts

Apr 30 2019

epriestley added a comment to T13279: Build Charting for Facts.

I think a possible model for the UI is to have some base ChartConfigurationEngine, similar to SearchEngine, which defines a set of fields. Some fields would be common (e.g., all time-series charts can have time controls for domains).

Apr 30 2019, 10:31 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

The concrete use cases that are currently filed are:

Apr 30 2019, 10:23 PM · Plans, Facts
epriestley removed a parent task for T4171: Building reporting and data systems: T6821: Allow querying for open Maniphest tasks with an assignee set for ages ("cookie licking").
Apr 30 2019, 8:57 PM · Restricted Project, FreeBSD, Wikimedia, Facts
epriestley closed T4171: Building reporting and data systems as Resolved.

This is approximately coming into existence and this task no longer serves much of a purpose. See T13083 / T13279 for followups.

Apr 30 2019, 8:57 PM · Restricted Project, FreeBSD, Wikimedia, Facts
epriestley closed T1562: Build "Facts", an ETL pipeline and charting application as Resolved.

This now approximately exists and is no longer of much use as a standalone task. See T13279 and elsewhere for followups.

Apr 30 2019, 8:52 PM · Restricted Project, Wikimedia, Facts
epriestley closed T1562: Build "Facts", an ETL pipeline and charting application, a subtask of T4171: Building reporting and data systems, as Resolved.
Apr 30 2019, 8:52 PM · Restricted Project, FreeBSD, Wikimedia, Facts
epriestley closed T1562: Build "Facts", an ETL pipeline and charting application, a subtask of T6041: Metrics for Maniphest, as Resolved.
Apr 30 2019, 8:52 PM · Wikimedia, Facts, Maniphest
epriestley added a revision to T13279: Build Charting for Facts: D20489: Start the fact daemon in "bin/phd start".
Apr 30 2019, 4:52 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20487: Remove the legacy chart behavior from Maniphest.
Apr 30 2019, 3:56 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20486: Replace the chart in Maniphest Reports with a chart driven by Facts.
Apr 30 2019, 3:42 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20485: Add a rough "Chart" Dashboard Panel.
Apr 30 2019, 3:36 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20483: Render charts from storage instead of just one ad-hoc hard-coded chart.
Apr 30 2019, 3:31 PM · Plans, Facts
epriestley added a comment to T13279: Build Charting for Facts.

hmmm

Apr 30 2019, 3:18 PM · Plans, Facts

Apr 18 2019

epriestley added a revision to T13279: Build Charting for Facts: D20452: Separate "accumulate(...)" from Fact functions.
Apr 18 2019, 9:07 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20449: Copy the "line-chart" behavior to "line-chart-legacy" to keep "Maniphest > Reports" working.
Apr 18 2019, 1:41 PM · Plans, Facts

Apr 17 2019

epriestley added a revision to T13279: Build Charting for Facts: D20446: Simplify implementation of "pure" Chart functions.
Apr 17 2019, 10:08 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20445: Make chart function argument parsing modular/flexible with 900 pages of error messages.
Apr 17 2019, 6:29 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20444: Add a "sin()" function to charts.
Apr 17 2019, 2:28 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20443: Add chart functions "x()" and "constant(3)".
Apr 17 2019, 2:04 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20442: Select the domain (X-axis range) for charts before pulling data.
Apr 17 2019, 1:09 PM · Plans, Facts
epriestley updated the task description for T13279: Build Charting for Facts.
Apr 17 2019, 1:03 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20441: Separate chart functions into a class tree.
Apr 17 2019, 12:23 PM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20440: Fetch chart data via async request and redraw charts when the window is resized.
Apr 17 2019, 2:31 AM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20439: Support drawing multiple functions on the same chart.
Apr 17 2019, 2:01 AM · Plans, Facts
epriestley added a revision to T13279: Build Charting for Facts: D20438: Fix negative chart values, add storage for charts.
Apr 17 2019, 1:33 AM · Plans, Facts

Apr 16 2019

epriestley triaged T13279: Build Charting for Facts as Normal priority.
Apr 16 2019, 5:41 PM · Plans, Facts

Apr 11 2019

epriestley closed T13275: Build Portals: a standalone menu page / dashboard of dashboards, a subtask of T13083: Plans: Portals and Facts, as Resolved.
Apr 11 2019, 3:00 PM · Plans, Facts, Dashboards

Mar 31 2019

epriestley moved T13083: Plans: Portals and Facts from Backlog to Next on the Dashboards board.
Mar 31 2019, 10:00 PM · Plans, Facts, Dashboards

Mar 29 2019

epriestley updated the task description for T13083: Plans: Portals and Facts.
Mar 29 2019, 5:27 PM · Plans, Facts, Dashboards

Mar 28 2019

epriestley moved T13083: Plans: Portals and Facts from Soon to Next on the Plans board.
Mar 28 2019, 3:39 PM · Plans, Facts, Dashboards

Mar 27 2019

epriestley updated the task description for T13083: Plans: Portals and Facts.
Mar 27 2019, 2:16 PM · Plans, Facts, Dashboards

Dec 3 2018

epriestley updated the task description for T13083: Plans: Portals and Facts.
Dec 3 2018, 6:11 PM · Plans, Facts, Dashboards

Oct 25 2018

epriestley updated the task description for T13083: Plans: Portals and Facts.
Oct 25 2018, 4:08 PM · Plans, Facts, Dashboards

Sep 4 2018

epriestley updated the task description for T13083: Plans: Portals and Facts.
Sep 4 2018, 7:34 PM · Plans, Facts, Dashboards

Mar 17 2018

epriestley added a comment to T13083: Plans: Portals and Facts.

The task.open-count.status counts open tasks that are the result of a status change (an existing task being closed, or a closed task being reopened). Since it's much more common for existing open tasks to be closed than for existing closed tasks to be reopened, the series should go negative pretty quickly and stay there over time, more or less ending up with a big negative number of "number of tasks ever closed".

Mar 17 2018, 5:16 PM · Plans, Facts, Dashboards
sshannin added a comment to T13083: Plans: Portals and Facts.

Not sure if it's expected in the current state, but here's one that doesn't seem well-formed: https://secure.phabricator.com/fact/chart/?y1=tasks.open-count.status

Mar 17 2018, 4:54 PM · Plans, Facts, Dashboards

Mar 5 2018

epriestley added a comment to T13083: Plans: Portals and Facts.

Just to briefly touch this:

Mar 5 2018, 3:15 PM · Plans, Facts, Dashboards
epriestley moved T13083: Plans: Portals and Facts from Backlog to Soon on the Plans board.
Mar 5 2018, 3:02 PM · Plans, Facts, Dashboards

Feb 25 2018

epriestley added a project to T13083: Plans: Portals and Facts: Plans.
Feb 25 2018, 3:28 PM · Plans, Facts, Dashboards

Feb 21 2018

epriestley added a comment to T13083: Plans: Portals and Facts.

See PHI385. I think I stabilized the dashboard arrangement issues in D19123, but the arrange workflows are still in somewhat rough shape.

Feb 21 2018, 1:30 AM · Plans, Facts, Dashboards
epriestley added a revision to T13083: Plans: Portals and Facts: D19123: Make dashboard arrange actions (move, add, remove) work again after read locking from "chaos reduction".
Feb 21 2018, 1:20 AM · Plans, Facts, Dashboards

Feb 19 2018

epriestley added a revision to T13083: Plans: Portals and Facts: D19122: Fix some of the most obvious bugs in fact generation from Maniphest tasks.
Feb 19 2018, 7:38 PM · Plans, Facts, Dashboards
epriestley added a revision to T13083: Plans: Portals and Facts: D19121: Provide a page for examining the facts an object generates.
Feb 19 2018, 5:43 PM · Plans, Facts, Dashboards
epriestley updated the task description for T13083: Plans: Portals and Facts.
Feb 19 2018, 3:15 PM · Plans, Facts, Dashboards

Feb 18 2018

epriestley added a revision to T13083: Plans: Portals and Facts: D19120: Extract count/point data from tasks in Fact engines.
Feb 18 2018, 5:30 PM · Plans, Facts, Dashboards
epriestley added a revision to T13083: Plans: Portals and Facts: D19119: Make Facts more modern, DRY, and dimensional.
Feb 18 2018, 3:31 PM · Plans, Facts, Dashboards
epriestley added a comment to T13083: Plans: Portals and Facts.

One overarching issue here is that facts don't have a clear permissions model. It's bad if anyone can go look up the burndown chart for #critical-security-issues and then correlate that chart against tasks showing up in #weird-things-that-happen-when-you-hold-down-the-letter-a or whatever and get a hint about a security concern. In the general case, charts like "Salary by Employee", "Acuisitions Affecting our Stock Price", etc., are also potentially problematic.

Feb 18 2018, 2:30 PM · Plans, Facts, Dashboards

Feb 17 2018

epriestley added a comment to T13083: Plans: Portals and Facts.
  • Fact cursors are currently per-object. I think they should likely be per <object, engine> pair so that subsets can be rebuilt more quickly for testing/development and the failure of one engine will not stop all other engines from processing data. On the other hand, fact processing is currently pretty fast and I don't expect to write a ton of engines so I'm not sure how critical this really is. Engines likely don't care how cursors work unless they depend on facts extracted by other engines and need to guarantee they execute later.
  • FactEngine->getFactSpecs() isn't really authoritative -- it takes a fact definition externally. I think this should become the authoritative generator. That is, this piece of code needs to go sooner rather than later:
Feb 17 2018, 3:02 PM · Plans, Facts, Dashboards
epriestley updated the task description for T13083: Plans: Portals and Facts.
Feb 17 2018, 2:27 PM · Plans, Facts, Dashboards

Feb 15 2018

epriestley added projects to T13083: Plans: Portals and Facts: Dashboards, Facts.
Feb 15 2018, 8:52 PM · Plans, Facts, Dashboards

Jan 4 2018

epriestley added a revision to T13020: Migrate Maniphest transactions to improve consistency: D18854: Sort burnup data chronologically after merging synthetic and "real" data.
Jan 4 2018, 6:22 PM · Transactions, Facts, Maniphest
epriestley added a revision to T13020: Migrate Maniphest transactions to improve consistency: D18853: Pile more atrocities onto the Maniphest burnup report.
Jan 4 2018, 5:43 PM · Transactions, Facts, Maniphest

Nov 22 2017

epriestley added a revision to T13020: Migrate Maniphest transactions to improve consistency: D18777: Freeze "maniphest.gettasktransactions" and make status/priority transactions more consistent.
Nov 22 2017, 2:15 PM · Transactions, Facts, Maniphest
epriestley created T13020: Migrate Maniphest transactions to improve consistency.
Nov 22 2017, 2:09 PM · Transactions, Facts, Maniphest

May 8 2017

chad merged T10541: Maniphest report by project not showing proper results into T1562: Build "Facts", an ETL pipeline and charting application.
May 8 2017, 5:25 PM · Restricted Project, Wikimedia, Facts

May 5 2017

chad merged T12675: Burnup rate month date shown in tool tip is off by one (January is month zero) into T1562: Build "Facts", an ETL pipeline and charting application.
May 5 2017, 1:50 PM · Restricted Project, Wikimedia, Facts

Apr 25 2017

chad merged T12641: Maniphest burnup rate report: by user into T1562: Build "Facts", an ETL pipeline and charting application.
Apr 25 2017, 1:43 PM · Restricted Project, Wikimedia, Facts

Apr 12 2017

epriestley moved T12177: Provide time-to-review statistics and reporting in Facts from Backlog to Requests on the Customer Impact board.
Apr 12 2017, 3:37 PM · Customer Impact, Differential, Restricted Project, Facts, Feature Request
epriestley edited projects for T12177: Provide time-to-review statistics and reporting in Facts, added: Customer Impact; removed Phacility.
Apr 12 2017, 3:37 PM · Customer Impact, Differential, Restricted Project, Facts, Feature Request

Apr 7 2017

epriestley added a subtask for T1562: Build "Facts", an ETL pipeline and charting application: T12459: Provide evidence-based forecasting of projects.
Apr 7 2017, 12:37 PM · Restricted Project, Wikimedia, Facts

Mar 27 2017

chad merged T5567: Add custom charts to a page into T1562: Build "Facts", an ETL pipeline and charting application.
Mar 27 2017, 4:00 PM · Restricted Project, Wikimedia, Facts

Mar 20 2017

epriestley added a subtask for T1562: Build "Facts", an ETL pipeline and charting application: T12410: Cycle Time and Lead Time Reports.
Mar 20 2017, 2:17 PM · Restricted Project, Wikimedia, Facts
epriestley added a subtask for T1562: Build "Facts", an ETL pipeline and charting application: T12403: Multi-category burnup charts.
Mar 20 2017, 2:17 PM · Restricted Project, Wikimedia, Facts

Mar 19 2017

chad merged T12419: Sorting doesn't work in Maniphest > Reports into T1562: Build "Facts", an ETL pipeline and charting application.
Mar 19 2017, 11:05 PM · Restricted Project, Wikimedia, Facts

Mar 15 2017

epriestley added a subtask for T1562: Build "Facts", an ETL pipeline and charting application: T12402: Report on team velocity.
Mar 15 2017, 10:30 PM · Restricted Project, Wikimedia, Facts
epriestley added a project to T12177: Provide time-to-review statistics and reporting in Facts: Phacility.

We have SAAS customer interest in this too, now.

Mar 15 2017, 4:11 PM · Customer Impact, Differential, Restricted Project, Facts, Feature Request

Feb 21 2017

epriestley closed T5334: View a graph showing worker load over time as Resolved.

This is 2+ years old and autoscaling probably covers it now. T5401 is probably a more tangible attack on this.

Feb 21 2017, 12:23 AM · Restricted Project, Facts, Daemons

Feb 13 2017

chad merged T12260: Report on historical assignment of points into T1562: Build "Facts", an ETL pipeline and charting application.
Feb 13 2017, 11:47 PM · Restricted Project, Wikimedia, Facts
chad merged T12259: Report on delta in task list between two points in time into T1562: Build "Facts", an ETL pipeline and charting application.
Feb 13 2017, 11:46 PM · Restricted Project, Wikimedia, Facts
epriestley added a comment to T12177: Provide time-to-review statistics and reporting in Facts.

The WMF downstream has some similar discussion here and in linked tasks:

Feb 13 2017, 1:17 PM · Customer Impact, Differential, Restricted Project, Facts, Feature Request