Skip to content
academia.sh

Course Advanced

Detection, Response and Compliance

Published Updated

By the end of this course

Start course

01

Detection and Response

Measuring how well application telemetry can answer the questions asked after an incident: matching the question set against the log schema and counting the unanswered questions, the volume and retention cost of each extra field, what a threshold misses and falsely wakes up in detection scenarios based on business logic, the step–record dependency in application breach response and the minute cost of a missing record, the window of items that can be written out in short-lived workloads, and the verification and fix times in the external report intake and bug bounty program.

  1. 01 Audit Log Design Matched against three log sources, a set of sixteen questions leaves six answered and ten unanswered: four because the field is not written, five because no join key links the sources, one because of the retention window. Three added fields raise the answered count to 13, but once all five are added the daily volume grows 1.45 times, retention under the fixed budget falls from 65 days to 45, and the five questions that reach into the 60-day audit period go unanswered again, so the answered count drops to 10.
  2. 02 Application-Specific Detection Scenarios In an event stream of 900 sessions, 18 abuse sessions are searched for with four detection scenarios. Scanning thresholds one at a time gives the same trade-off on every metric: a denied-authorization threshold of 3 yields 364 false positives and 211 off-hours pages, while 25 yields zero false positives but zero catches. When the four scenarios are chosen together, an alert budget of 25 catches 8 of the 18 sessions and a budget of 180 catches all 18 — the latter means 101 night pages in 30 days. When the out-of-region read field is not written, the number caught at the same budget falls from 15 to 13.
  3. 03 Application Breach Response In an unauthorized-access breach, twelve response steps are run against four log schemas. In the base schema seven steps are left without a record, the total takes 630 minutes and two steps cannot be completed at all; in the widest schema the same response takes 151 minutes, 4.17 times shorter. The absence of a record prolongs steps by between 4 and 8.3 times. The containment decision is made at minute 10 in every schema — the difference is not in containment but in scoping: when the affected subscriber set cannot be derived, the notification widens from 380 subscribers to an upper bound of 41,200 subscribers.
  4. 04 Trace in Short-Lived Workloads 2,000 short-lived workloads produce 671,501 log items and 642,504 of them are written out: the loss is only 4.3%. In the same data, the last item of the workload can be collected in only 115 of 2,000 workloads, and not a single item comes out of the 92 workloads of the failed exit class. When the level of detail is raised eight times, the items written out rise to 4,272,000, but the number of workloads that answer the authorization decision question falls from 1,218 to zero. The cost of the setting that collects all items is 91,084 extra flush requests and 33 core-minutes of extra lifetime.
  5. 05 External Report Intake Of the 340 reports arriving in 180 days, 91 are unique; 190 are duplicates and 59 are out of scope, so 73% of the queue carries no new vulnerability. At a triage capacity of two items per day the queue rises to 104 items and the mean wait is 31.2 days. Run against four log schemas, verification falls from 28.6 days to 25.8 days but the time from report to fix rises from 85.7 days to 89.9 days. The definite answer to the exploitation question rises from 15 to 20 and then falls to 13 in the widest schema; what raises the same number to 24 is not an extra field but raising triage capacity from 2 to 5.

02

Application Compliance

Counting the engineering equivalent of an audit item: how many of twenty-six controls fall on a practice the team actually runs and how many fall on none, whether the answer to a control comes from a query, a document, or an individual's declaration, how far generating evidence in the pipeline reduces the items collected by hand and what cost automatic evidence creates in volume, retention, and personal data, how mean time to remediate and open finding age read in opposite directions from the same data, and how many items lack the timestamp the metric needs in order to be computed.

  1. 01 Engineering Equivalent of Controls Twenty-six audit items are matched with the eighteen practices of an application team: after 25 links, 17 controls have an equivalent, 9 controls have no engineering equivalent at all, and five of those are gathered in a single compliance source. A control with an equivalent falls on 1.47 practices on average, 10 controls rest on a single practice, 2 practices fall on no control, and only 11 of the 26 questions are answered by querying the record.
  2. 02 Evidence Automation Twenty-four audit evidence items are moved into the pipeline: the items touched by hand fall from 24 to 9, the annual compilation load falls from 213 hours to 96.2 hours, the 170-hour setup pays back in 1.46 years, and six items never become automatic under any condition. The cost appears in the opposite column: evidence records per period rise from 24 to 72,401, a factor of 3,017, the sampling rate falls from 100% to 0.63%, and the six items carrying a personal data type answer only 24.7% of the period because of a 90-day retention window.
  3. 03 Application Security Metrics Of the 142 findings, the 121 that closed have a mean time to remediate of 17.0 days and a median of 6 days: the 30 items above the mean carry 75% of the total days. The same set gives opposite directions under two grouping rules — counted in the half it opened it falls from 23.6 to 7.6, counted in the half it closed it rises from 13.2 to 20.0 — and while the open queue falls from 24 items to 21, its mean age rises from 30.4 days to 59.8 days. Of eight questions, five are answered fully, one partially, and two are unanswered. Three interventions that improve the metric fix zero items: the mean goes to 12.6 days, the open finding age to 23.4 days, and the within-target rate to 94.2%.
  4. 04 Security Debt Of a 34-item debt ledger, 21 are open and 13 are accepted risk; only 5 of the acceptances carry a validity period and only 2 carry a reassessment point. Of six questions, one is answered fully, four partially, and one is unanswered; making the partial answers full requires writing 26 fields. A four-period queue with 48 person-days of capacity closes 11 items of the 209 person-day ledger, and the mean age of the remaining queue rises from 91 days to 360 days. The 8 accepted items whose validity was never written are never asked about again in any period; of the 3 expired acceptances, only one carries a reassessment point.

Final exam

Detection, Response and Compliance — Final Exam

In preparation

This course's question bank is not complete yet. The exam opens here automatically once enough questions are added.

Start typing to search.

↑↓ ↵ Esc navigate · open · close