Check out our companion blog!
Oct. 19, 2026

Building an Incident Response Team (Before You Need One)

Building an Incident Response Team (Before You Need One)
Building an Incident Response Team (Before You Need One)
The Backup Wrap-up
Building an Incident Response Team (Before You Need One)

Building an incident response team is something you do before the incident, not during it. Prasanna, Dr. Mike Saylor, and I walk through who needs to be on that team, why each person matters, and how to get them lined up now so nobody’s scrambling when ransomware hits.

We’re back after a few weeks off, and we came back with a topic I care a lot about. When I cracked a rim on my Tesla, I didn’t watch YouTube videos and grab a wrench. I called a team of people who know tires. Your cyber incident deserves the same treatment. Mike puts it plainly: you don’t want to be recruiting people when the house is on fire.

We cover the core roles. There’s the incident commander, who keeps the business off the backs of the people putting out the fire. There are the subject matter experts on the tech side. And there’s the executive sponsor, who makes the calls you’re not allowed to make. We talk about why legal, compliance, PR, and finance need a seat at the table. We also explain why “there is no evidence customer data was accessed” is a very different sentence from “customer data was not accessed.” (Looking at you, LastPass.)

Then we get into the outside help: your cyber insurance carrier, a third-party incident response firm with a retainer already signed, law enforcement, and your vendors. Mike explains what the FBI will and won’t do for you. He covers why you can’t just pay a ransom to anyone on the OFAC list, and why calling Bob on a Sunday is not a plan.

If your current incident response plan is “we’ll figure it out,” this episode is for you. Listen in, then go write down some names.

Chapters:

00:00 Cold open

01:30 We’re back (and Gemini let me down)

03:27 Why you need a team, not YouTube University

04:29 Know your team before the house is on fire

07:43 Fire crews, training, and the USS Constellation

09:27 Incident response is a business problem

12:02 Core roles: leaders and subject matter experts

14:14 Executive sponsors and who comes back first

16:09 Asset lists, owners, and pre-authorization

17:11 Incident commander vs. incident leads

20:00 Legal, compliance, and attorney-client privilege

22:59 PR and the LastPass problem

24:47 Finance and cyber insurance

27:07 Third-party incident response teams and retainers

32:06 Bringing in law enforcement

33:48 Sanctions, Bitcoin, and paying the ransom

38:05 Vendors who answer the phone on a weekend

39:34 Write it down and name your deputies

40:20 Tabletop exercises

43:06 Wrap-up

Speaker:

When you need your incident response team, it's too late to

Speaker:

build your incident response team.

Speaker:

Yeah, we've been gone a few weeks.

Speaker:

Sorry about that.

Speaker:

My life got turned upside down for a bit, but we're back.

Speaker:

Prasanna, Dr. Mike Saylor, and I are talking about building an incident

Speaker:

response team before you actually need it.

Speaker:

We talk about things like who's in charge, who decides which app comes

Speaker:

back first when everybody's saying that theirs is the most important one.

Speaker:

Why do legal, PR, finance, and your cyber insurance company

Speaker:

all need to be at the table?

Speaker:

Also, why should your outside incident response team already

Speaker:

have a signed retainer?

Speaker:

We get into all of this on this week's episode.

Speaker:

If this is your first time watching or listening to me, I'm

Speaker:

W. Curtis Preston, AKA Mr. Backup.

Speaker:

I've been obsessing over backup, recovery, and now cyber recovery for over 30 years.

Speaker:

If that's your bag, I'm your guy.

Speaker:

You're not gonna find anyone that cares about this topic more than me.

Speaker:

Ever since 1993 when I had to tell my boss there were no backups of the

Speaker:

production database we just lost.

Speaker:

Now I've written five O'Reilly books, a blog, and now this podcast.

Speaker:

Here we turn unappreciated admins into cyber recovery heroes.

Speaker:

This is the Backup Wrap-Up.

Speaker:

Hi, and welcome to The Backup Wrap Up.

Speaker:

I'm your host, W. Curtis Preston, AKA Mr. Backup.

Speaker:

We're back after a little bit of a break, and I have with me, the guy

Speaker:

who I hope goes to battle with me, against, Gemini, Prasanna Malaiyandi.

Speaker:

How's it going, Prasanna?

Speaker:

I'm good, Curtis.

Speaker:

I have no comment on your battles.

Speaker:

I wish you the best of luck, but that is a fight you will have to fight on your own

Speaker:

Yeah, So Gemini, Gemini let me down, Prasanna.

Speaker:

I was was using it to do some stuff for the podcast and then right

Speaker:

at the crucial moment Gemini's "What? What are you talking about?"

Speaker:

Yeah, no comment

Speaker:

it was like it said, "Hey, I'm focusing on the artificial part, of the

Speaker:

intelligence." so artificial I couldn't find the outline that we were looking for

Speaker:

and of course we have with us my co-author from, Learning Ransomware

Speaker:

Response and Recovery, Dr. Mike Saylor.

Speaker:

How's it going, Mike?

Speaker:

Doing well.

Speaker:

Hey, guys

Speaker:

are you having a better week than me?

Speaker:

I'm having quite the week

Speaker:

it's been a week.

Speaker:

haven't had any car damage or anything, in the real… It's all

Speaker:

been, it's all been, just work related

Speaker:

I've spent, way too many hours in a tire repair facility, due to a, sadly

Speaker:

a cracked rim, which I'm guessing we're blaming that on potholes.

Speaker:

But, luckily, replacing rims on a Tesla, super cheap.

Speaker:

So, um, I kid,

Speaker:

that sarcasm I sensed there, Curtis?

Speaker:

sarcasm

Speaker:

to come in.

Speaker:

of the weak.

Speaker:

Yeah.

Speaker:

so I, yeah, I had to go with aftermarket rims 'cause I wasn't

Speaker:

spending, It was, like, it was, like, close to, $900 or something on a rim.

Speaker:

I was like, "No, thanks."

Speaker:

So anyway, we are here to talk about,

Speaker:

cars, more cars?

Speaker:

at least, when you think about what was going on with me, I have a team

Speaker:

of people that I can, that when I have a t- when I have a tire problem, I

Speaker:

can bring my car to these people, and these people will take care of it.

Speaker:

I don't know squat about tires.

Speaker:

So I got a team of people to do that.

Speaker:

And that's what we're gonna talk about here today, is building a team of people

Speaker:

to help you when it's time, and notice I said when it's time to have an incident.

Speaker:

and just for clarification, this is like a real team, not YouTube University

Speaker:

or one of those things where you learn a bunch of information and that's it

Speaker:

Yeah.

Speaker:

you don't want to, be responding to a cybersecurity incident the way

Speaker:

that I respond to, let's say, an odd thing happening in my house, right?

Speaker:

and, Prasanna is right?

Speaker:

I'm gonna pull up YouTube, I'm gonna watch a bunch of videos, then at some

Speaker:

point in those videos, I'm either gonna say one of two things: "I can

Speaker:

do this," or, "There's no way I'm gonna do this." And and then I'm gonna

Speaker:

call, I'm gonna call people to make it

Speaker:

happen,

Speaker:

Anyway, Mike, what's your opinion about, the importance

Speaker:

of a incident response team?

Speaker:

the most important part is knowing who they are.

Speaker:

you don't wanna assemble that team when the house is on fire, 'cause you may

Speaker:

spend a lot of time trying to recruit somebody that just won't participate

Speaker:

or is the wrong resource to begin with.

Speaker:

So preparation is definitely key, when together a incident response

Speaker:

team and getting the buy-in and dedication and accessibility of the

Speaker:

people that you're gonna rely on

Speaker:

Before we talk about the team, maybe it might be helpful to talk about

Speaker:

like what is incident response and why do I even need a team to start with?

Speaker:

And so something happens and you need to, one, figure out like what happened, how to

Speaker:

stop the bleeding, and then try to figure out what went wrong and how to recover.

Speaker:

And so the incident response team has different skill sets

Speaker:

amongst different people, right?

Speaker:

If it's a cyber recovery targeting things, you might need more tech people.

Speaker:

If it's some other type of incident, maybe it is a different set of folks you need.

Speaker:

it's just physical bandwidth.

Speaker:

not one person or even maybe even a couple of people could truly,

Speaker:

put out the fire in a timor.

Speaker:

and like fire, time is of the essence.

Speaker:

The faster you put the fire out, the, the less likely it's gonna spread.

Speaker:

So you wanna contain it, you wanna extinguish it, then

Speaker:

you wanna do some triage.

Speaker:

How did it happen, and how do we prevent it from happening again, and

Speaker:

how bad was the damage, and so on.

Speaker:

so the ability of one or just a couple of people to do all that, efficiently

Speaker:

and effectively is pretty rare.

Speaker:

and wouldn't bet on that even on our team.

Speaker:

I would want to know that I've got this pretty good list of people,

Speaker:

resources, skills, 'cause you never know what kind of fire it's gonna be.

Speaker:

that's why there's different classes of fire extinguisher, right?

Speaker:

there's dry fire extinguishers, there's wet, there's gas.

Speaker:

and so you have to assess what kind of incident, what kind of

Speaker:

fire it is, and then from your list of resources, you assemble the

Speaker:

right team, to tackle that problem

Speaker:

maybe it's, a terrorist attack.

Speaker:

Maybe it's a fire.

Speaker:

Maybe it is an actual fire, right?

Speaker:

I think immediately about the OVH fire, right?

Speaker:

th- there are just different people that are gonna have different skills, some

Speaker:

of which might be, they might just be really good at ordering stuff, right?

Speaker:

the, it's definitely a skill, especially in today's world, there's, it's a real

Speaker:

skill of acquiring new equipment, right?

Speaker:

because it can… You could go and say, "Okay, I need, I need 15 Dell

Speaker:

ABC 123s," and Dell's yeah, you can have those in two weeks," right?

Speaker:

Or six weeks or whatever, right?

Speaker:

so there are people that have been dealing with those scarcity issues right

Speaker:

now, and they're really good at it.

Speaker:

So in a case of a fire situation or a flood situation where the actual

Speaker:

equipment is physically damaged or completely obliterated, then that team

Speaker:

is going to be different than a team, a cyber team where the servers are

Speaker:

fine, everything's fine, it's just, they don't work, the way they used to.

Speaker:

All right.

Speaker:

and, we've been talking about, we've been talking about fire, and again, going back

Speaker:

to that, when you think about, I don't know about you guys, but I watch a lot

Speaker:

of TV, and I watch a lot of like "911" or, going all the way back to the '70s.

Speaker:

Wasn't that "Emergency," Mike?

Speaker:

W- that was, it was "Emergency," wasn't it, back in the day?

Speaker:

and one of the things that you see in that, in that world is you have a

Speaker:

concept of a fire team, and you have the concept of a probie, and you have

Speaker:

a concept of when they get to a fire, everyone knows what their job is, right?

Speaker:

you're, you got the guys whose job it is to find the fire hydrant.

Speaker:

You got the guys that are to hook the hose up to the fire hydrant.

Speaker:

You got the guys whose job it is to identify the, the hot spots of the fire.

Speaker:

and just like this, they do not figure that out on the spot.

Speaker:

They do training and they identify who these people are.

Speaker:

They do training.

Speaker:

as a Navy veteran, I can tell you that we went through training.

Speaker:

and, th- like you've heard, every Marine or rifleman, every

Speaker:

s- sailor is a fireman, right?

Speaker:

Because, when you go out to sea, i- if something bad happens, y- gotta know

Speaker:

what to do with a fire hose, right?

Speaker:

Didn't you have to deal with the fire on a ship once?

Speaker:

I did.

Speaker:

we don't have time to tell that story, but I participated in fire that many

Speaker:

would say was one of the top 10 worst, fires in the history of the US Navy,

Speaker:

where we dump- we accidentally dumped 10,000 gallons of jet fuel into the

Speaker:

boiler room, where as the citation goes, where there were a number of things

Speaker:

in excess of the flashpoint of JP-5.

Speaker:

we fought that fire for 29 hours right off the coast here.

Speaker:

good times back in 1988.

Speaker:

Feel free to look up the story of the USS Constellation.

Speaker:

Also I, would say that incident response is, it's not really, it's not as much like

Speaker:

of an IT problem, it's a business problem.

Speaker:

There are many things that are going to be taking place that, I… the IT part,

Speaker:

the cyber part is a part of it, the recovery part is part of it, the potential

Speaker:

ordering of new equipment is part of it.

Speaker:

But that, those are just parts of the overall thing that's happening,

Speaker:

which is a business problem.

Speaker:

There's also things like, having to respond the public, right?

Speaker:

you're having to notify the public of what's going on.

Speaker:

we've talked about that, I know, in the past on the podcast, where it's like it's

Speaker:

equally important to, that you keep your customer base and even just interested

Speaker:

parties aware of what's going on, because how you notify the public i- is going to

Speaker:

be pers- it's going to change how the, the incident is perceived, and that is

Speaker:

also part of the incident response team.

Speaker:

You have, you look very,

Speaker:

like you're

Speaker:

I…

Speaker:

thinking, Prasanna.

Speaker:

no.

Speaker:

I, as you were talking through, I was just thinking it's like a business, problem,

Speaker:

but I think, the incident response part itself where you're gathering these

Speaker:

people and they have their different jobs and other things like that is really,

Speaker:

the process you go through in order to solve the business problem that is

Speaker:

there where everyone is coordinating amongst all these various things.

Speaker:

But you have, that process defined, right?

Speaker:

It's if we need to do X because we got hit with, ransomware, here are

Speaker:

all the people that are involved.

Speaker:

Here are their roles and their responsibilities and what they're

Speaker:

targeting, and here's a person who's going and communicating with external

Speaker:

stakeholders or with the cyber insurance company or with executives, and legal

Speaker:

counsel and everything else, right?

Speaker:

So it's like bringing all these various people together who have

Speaker:

different expertise into a process in order to solve that business problem

Speaker:

Yeah, and that would be the incident response plan, right?

Speaker:

and then th- this is the team that's going to enact that.

Speaker:

And by the way, just, the other thing to just drive this home, the thing that

Speaker:

we… the, the whole core concept of the book was that there are a number

Speaker:

of books you can go get to tell you how not to get ransomware, right?

Speaker:

Or how not to get a cyberattack against you.

Speaker:

And our book is like, "You're probably gonna get ransomware." So

Speaker:

like statistically speaking, it's probably gonna happen to you, and so

Speaker:

you need to be able to… You need to prepare to be able to respond.

Speaker:

And let's start talking about, s- the core roles that we talk about when we're

Speaker:

building an incident response team.

Speaker:

Mike, you wanna lead there?

Speaker:

Sure.

Speaker:

I've got a funny story real quick.

Speaker:

I- you'll probably cut this out, but I w- I was on the Russ Martin Show years ago.

Speaker:

I don't know if you remember that guy.

Speaker:

he was a radio disc jockey in, in Dallas for a while, and

Speaker:

then just started a, a, a show.

Speaker:

And, they called me to ask about ransomware and, along the… during

Speaker:

the conversation he asked, what kind of things can we do to prevent

Speaker:

ransomware?" I told him to stop going to porn sites, and they hung up on me.

Speaker:

a- anyway

Speaker:

That's pretty

Speaker:

All right

Speaker:

that's solid advice for The record.

Speaker:

Solid advice

Speaker:

The same advice I gave some military officers.

Speaker:

But, yeah, so as far as developing the team, you wanna start with

Speaker:

your subject matter experts.

Speaker:

So you've got a, you've got a leader, and that leader can be,

Speaker:

situational.

Speaker:

and as a leader, I may say I'm in charge until I figure out that I'm not

Speaker:

the right person to be in charge, and that's really the right leader you want.

Speaker:

but then who are all your subject matter experts?

Speaker:

You want your network person, your system person, your backup person, architecture,

Speaker:

apps, database, on the technology side.

Speaker:

that's aware and can reach out to all your vendors.

Speaker:

and then I wanna go back to something you mentioned earlier, that a lot of

Speaker:

incidents aren't just an IT problem.

Speaker:

Business almost completely runs on technology within an organization,

Speaker:

so if IT's having an incident, it's gonna affect, affect or

Speaker:

impact the business to some degree.

Speaker:

and that's gonna drive like urgency and prioritization and some of that stuff,

Speaker:

and that's key too if you don't al-also already have subject matter experts from

Speaker:

the business side, then you're gonna get people calling you left and right telling

Speaker:

you their stuff is more important than the other people's stuff, and you've

Speaker:

gotta prioritize this and things that way.

Speaker:

which all goes back to making sure that you've done your diligence and

Speaker:

your homework on preparing how to, at least at a high level, respond

Speaker:

to an incident and who should be involved and who the key people are.

Speaker:

N- you talk about the, another thing that i- is really key here to dealing with

Speaker:

the situation that you just mentioned is that i- in addition to having an in- an

Speaker:

incident response coordinator or a person that's in charge of the incident itself,

Speaker:

you also need have previously identified who are the business people, who are the,

Speaker:

the executive sponsors of this event?

Speaker:

who is the person that we have to listen to, right?

Speaker:

And who are the people that if they call, we get to say, "You

Speaker:

go call that person," right?

Speaker:

I, I definitely remember I've been in incidents where in the middle of

Speaker:

those incidents, we're getting, just like you talked about, like competing,

Speaker:

instructions from different people in terms of my application is more important.

Speaker:

this is why we have a plan.

Speaker:

The plan in advance, we've already had all those discussions, hopefully.

Speaker:

We've al- already had those discussion about which applications

Speaker:

need to come up first, both from a technological perspective and

Speaker:

also a business perspective, right?

Speaker:

So like for example, we might decide that, Active Directory

Speaker:

has to come up first, right?

Speaker:

DNS has to come up first or second or whatever, because nothing

Speaker:

else is gonna come up, right?

Speaker:

But then there are business decisions of this particular part of the company has

Speaker:

to come up first because it's costing us X number of dollars per minute.

Speaker:

And if there is a decision that needs to be made in the moment where, based

Speaker:

on something that's going on with the business, that decision might

Speaker:

be made on high, and it definitely can't or not be made down here, right?

Speaker:

Even if you're the person in charge of this incident, you're not in

Speaker:

charge of the company, right?

Speaker:

and so it's really important to have executive sponsorship and a

Speaker:

person identified, back at the, at the executive level that we can

Speaker:

point to and, and to support us.

Speaker:

Any thoughts there?

Speaker:

Completely agree.

Speaker:

And capture all of that in writing.

Speaker:

and one of the easiest, I guess mo- almost fundamental things that you

Speaker:

should do, you've already got your asset list all your servers and applications.

Speaker:

a column that who's the, who the owner is of all, the IT owner and

Speaker:

the business owner, and their contact information, not just their email

Speaker:

address, but their phone number.

Speaker:

And there are certain cases where getting pre-authorization to do things

Speaker:

in a, critical moment will spare you the time of reaching out to those people.

Speaker:

for example, if the web server has ransomware, do I need to call the

Speaker:

owner, the business owner, and say, "Hey, I need to take that down, rebuild

Speaker:

it, 'cause it's gonna get worse"?

Speaker:

can I call them today and walk through a couple of critical situations and get

Speaker:

their pre-authorization to do X, Y, and Z?

Speaker:

Capture that in writing, and now you've got a playbook that says, "When these

Speaker:

things happen, just do it. get it done."

Speaker:

I have two questions.

Speaker:

the first is, do you normally have a incident lead for different types

Speaker:

of incidents , or is it just an incident lead at a company and all

Speaker:

incidents go through that one person?

Speaker:

So there can be, I, I'm trying not to say the word.

Speaker:

it, there can be more than one person, and sometimes it makes sense.

Speaker:

But usually there is coordinator, the incident commander, coordinator.

Speaker:

They're the ones that is… They're the buffer between the business and IT.

Speaker:

They're the ones that are, they're translating, they're setting expectations,

Speaker:

they're communicating, and they're keeping the business off of the people

Speaker:

that are trying to put the fire out.

Speaker:

much like the public liaison officer, for military law enforcement.

Speaker:

they're the face to the business side so that, "Don't look behind the curtain.

Speaker:

don't worry about what's going on back here.

Speaker:

It's gonna be okay.

Speaker:

and your next update will be in an hour." so that's the incident

Speaker:

commander, or coordinator.

Speaker:

And then you've got one to many leads because you may have, a situation

Speaker:

where this problem is so big, it's an infrastructure problem, it's a

Speaker:

database problem, it's a, data recovery problem, and you could have leads in

Speaker:

all those different areas that are

Speaker:

coordinated by, one, one additional, layer above them

Speaker:

I'd say the bigger you are as a company, the more likely it is you're

Speaker:

gonna have different people, right?

Speaker:

I, I pity the fool, t- that's at a small company and all of

Speaker:

these heads are you, right?

Speaker:

And we're gonna get to, one of the ways to ameliorate that, in a minute.

Speaker:

But bigger you… the more you can, Mike started out by talking

Speaker:

about subject matter experts.

Speaker:

The more you can have, the database person in charge of the database

Speaker:

situation, the backup person in charge of the backups, right?

Speaker:

The more you can have that available, because they're the ones that are

Speaker:

most equipped to deal with the weird things that they might encounter.

Speaker:

and, and I'd say th- there's no more position where that's relevant or

Speaker:

important than that, than the cyber one, because the, backups and recoveries,

Speaker:

they're, upfront they can be a lot of… They can be quite different,

Speaker:

but in the back end in a restore, most of them are very much the same.

Speaker:

it, but cyber is not at all, right?

Speaker:

Where, y- the, you've got this… All you know is something's going on.

Speaker:

Somebody's in the, in the woodwork.

Speaker:

and, we're not quite sure where they are, we're not quite sure who they are,

Speaker:

we're not quite sure what they're doing, but we know that something's going

Speaker:

on, and you've got to have somebody that really knows how to do that.

Speaker:

so that, that person is definitely, really important to have.

Speaker:

another group, speaking of the business, when we talk about, the,

Speaker:

the business, one of the other areas that we need are… two areas really,

Speaker:

and that's legal and then PR, right?

Speaker:

So legal is going to get involved in things like deciding whether or

Speaker:

to not to pay the ransom, right?

Speaker:

and w- what are the legal implications of that?

Speaker:

What are the legal implications of, let's say we've got an exfiltration

Speaker:

situation, and they've given us the proof of life that they have our data,

Speaker:

we now know what data they have, and legal can help make deter- de- the

Speaker:

determination this is something we care or don't care or, they know what

Speaker:

the, the impact of that is gonna be.

Speaker:

Was that

Speaker:

And I think also in some cases, like this is a very trying time for a

Speaker:

company, and so you may also want legal there in order to provide the advice,

Speaker:

legal advice and guidance and sort of the attorney-client privilege as

Speaker:

these discussions are happening, right?

Speaker:

Versus just being amongst like executive leadership or other things like that

Speaker:

Yeah, I completely agree with that.

Speaker:

there's several roles that you've mentioned that legal fills.

Speaker:

that attorney-client cl- attorney-client privilege is one

Speaker:

that we're seeing more these days, especially when you're engaging

Speaker:

outside resources to help you respond.

Speaker:

they want all of that to include the legal, team so that they

Speaker:

can put that under privilege.

Speaker:

one of the other areas is, compliance.

Speaker:

and so as the, the team is responding to the incident and providing feedback of

Speaker:

about what happened and been impacted, whether it's data or systems or, is it

Speaker:

an outage or a breach, it's on legal and the compliance team to determine if

Speaker:

that's a reportable incident and, the timing of that and the messaging for that.

Speaker:

and it's not just to, I, I guess to expand on that, it's not just

Speaker:

compliance for as far as messaging goes.

Speaker:

Even with PR involved, it's usually legal that's gonna to help massage, the language

Speaker:

around what we tell, third parties

Speaker:

Yeah, and that's gonna b- that, that is gonna be 100% based

Speaker:

on your jurisdiction, right?

Speaker:

I know, and obviously there are different types of data like HIPAA

Speaker:

data that have… and I could really only speak to the United States.

Speaker:

I'm sure th- I know like there's GDPR, that governs some of

Speaker:

the same kind of concepts.

Speaker:

But I know here in California, for example, if you, if customer data is

Speaker:

exposed, then you have a, a duty to inform within a reasonable amount of time.

Speaker:

reasonable is not defined.

Speaker:

But, And so yeah, you've gotta make sure that you're doing the,

Speaker:

what's, what is appropriate from a compliance perspective, right?

Speaker:

and speaking of which, we're talking about PR.

Speaker:

Outside of compliance, again, it's a matter of how do we properly

Speaker:

communicate this and how do we not communicate it, right?

Speaker:

We… I know Prasanna, we talked a lot on the

Speaker:

I w- I was just, I was thinking about

Speaker:

ahead.

Speaker:

space.

Speaker:

Ouch.

Speaker:

Yeah, that was a lot, right?

Speaker:

you have this desire, if you're somebody who communicates, with the public, like

Speaker:

your job is to make the company look good, you have this desire to minimize

Speaker:

the, the, the impact of the event or the, the, the perceived impact of the event.

Speaker:

actually the one that I'm really thinking about is actually, LastPass, right?

Speaker:

and it's like, "Well, they got the thing, but they didn't get the thing.

Speaker:

Well, they got… well, okay, well, they got the thing, but they didn't

Speaker:

get the thing. And then, well, they got the thing, but they didn't do the

Speaker:

thing." Yeah, they did all the things.

Speaker:

They got all the things and they did the thing and, and they just

Speaker:

kept, like revising the story.

Speaker:

the common phrase, and Mike, I'm sure you've seen this in so many

Speaker:

incidents, the common phrase is, "There is no evidence that customer

Speaker:

data has been accessed," right?

Speaker:

that's not the same thing as saying customer data has

Speaker:

not been accessed, right?

Speaker:

We do not yet have evidence that customer data has been accessed,

Speaker:

and so that, that's okay to say that until the evidence changes it.

Speaker:

But if you like, if you just come out and say, "Hey, customer data has not

Speaker:

been accessed," in the case of like LastPass saying vaults were not accessed,

Speaker:

it turns out they were accessed, right?

Speaker:

they're like, "Okay, they were accessed, but, it was encrypted, so they're probably

Speaker:

not gonna be able to get the stuff." okay, what we meant by that was, you don't

Speaker:

wanna have to keep re- replying that.

Speaker:

So you need somebody also on your team from a PR perspective that understands

Speaker:

those, those, nuances, right?

Speaker:

and, and then, we have finance on our list.

Speaker:

Why would finance be part of this, Mike?

Speaker:

Understand the impact of the incident.

Speaker:

how much are we losing an hour, a day?

Speaker:

How much did that thing cost?

Speaker:

How much money do you need to replace it?

Speaker:

Again, something also you should have pre-authorized.

Speaker:

but yeah, the, gonna know this, what the impact of this

Speaker:

incident has on the business

Speaker:

So I know in past episodes we've talked about cyber insurance and they come

Speaker:

in, they help you out, and there's a policy to help offset some of these

Speaker:

costs as you're looking to recover.

Speaker:

Is that coordinated by finance, by legal, by the incident response

Speaker:

commander, like all the above?

Speaker:

how does that flow with that external party?

Speaker:

It's usually compliance.

Speaker:

and so in, in larger companies, it's just called risk management.

Speaker:

So that's risk, compliance, insurance.

Speaker:

so from a traditional sense, risk is covered by insurance.

Speaker:

other organizations, it's either legal or actually somebody in IT as far as

Speaker:

vendor management goes, that would also manage the, insurance policies.

Speaker:

one of the things that, that we always recommend is include your insurance,

Speaker:

contact in your tabletop exercises, that helps you then learn what the expectations

Speaker:

are from insurance as to when, they want to be notified and how they want

Speaker:

to collaborate during an incident, even if it doesn't turn into a claim.

Speaker:

It's not like car insurance where you call and say, "I think I had an accident

Speaker:

that might-- I might need a claim." They're like, "Oh, really?" and so

Speaker:

it's not as, as bad as auto insurance.

Speaker:

corporate insurance is very helpful.

Speaker:

They'll actually give you some good tips and maybe even guidance, even

Speaker:

if it doesn't turn into a claim.

Speaker:

they'll work with you during an incident

Speaker:

and they also would have somebody that you can work with, during the incident, right?

Speaker:

To assist you in things like, negotiating if you end up having to

Speaker:

pay the ransom, negotiating the ransom.

Speaker:

This is somebody that, that obviously they want to negotiate

Speaker:

it down as little as possible.

Speaker:

and so you might have competing interests there, but this-- whoever that is,

Speaker:

we're talking about building the team.

Speaker:

Whoever that is, whoever your cyber insurance is, whoever your contact

Speaker:

is, you need to all of that, upfront.

Speaker:

And then, I'm going to, I'm gonna tackle this one, the next one, because otherwise

Speaker:

it would be, Mike promoting himself.

Speaker:

You also need, you need a third-party incident

Speaker:

response team, a blue team, as it were, right?

Speaker:

There's the blue teams and the red teams, right?

Speaker:

The blue teams are defense, red teams are offense.

Speaker:

And I very much… this is one of those things where don't

Speaker:

try this at home, kids, right?

Speaker:

is a professional driver on a closed track, whatever, whatever

Speaker:

analogy you want to use there.

Speaker:

the, the stories that I've heard from you, Mike, in terms of the, all of

Speaker:

the weird different ways that manifest themselves, then the way you respond

Speaker:

to those incidents really in the moment very much depends on your knowledge of

Speaker:

how, you're like, "Oh, we got this file.

Speaker:

That file has that extension.

Speaker:

That means this particular ransomware variant, which means that we're

Speaker:

dealing with the so-and-so group.

Speaker:

So this is how… And we know how they do, we know how they deal with things

Speaker:

because we've dealt with them before." only way you're gonna get that kind of

Speaker:

expertise is through in the field, in the trenches, and so that's why I do believe

Speaker:

strongly in having a team like yours, Mike, which is Black Swan Cybersecurity.

Speaker:

Mike is the CEO there.

Speaker:

And, bring, bringing you in, and again, we're talking

Speaker:

about building team up front.

Speaker:

This is part of the team.

Speaker:

Bring them in.

Speaker:

Do, there's this, this concept of a zero, zero dollar purchase order, right?

Speaker:

Create that relationship now.

Speaker:

maybe there's a retainer.

Speaker:

There probably is a retainer.

Speaker:

and then just have them, on speed dial so that in an incident, you can call them.

Speaker:

you wanna anything on there, Mike?

Speaker:

Sure.

Speaker:

That was great, Curtis.

Speaker:

I have nothing else to add.

Speaker:

the $0 retainers are a real thing, especially with law firms.

Speaker:

because, with law firms, they gotta, they have to do deconfliction

Speaker:

and some other things just to get all the paperwork out of the way

Speaker:

before they can even advise you.

Speaker:

so a lot of them offer $0 retainers just to start the relationship

Speaker:

and have all of that done.

Speaker:

And very similarly, incident response firms like ours, we would a retainer

Speaker:

in place also so that when you call us, we can start right then,

Speaker:

not five or eight hours later.

Speaker:

and then the other comment I was gonna make, as far as building

Speaker:

your incident response team, and Curtis touched on this, that team

Speaker:

doesn't have to be your employees.

Speaker:

we have several clients whose 100% of their incident response plan is call Mike.

Speaker:

and that's okay because they've identified they've, they have no internal resources

Speaker:

or bandwidth, and they need help.

Speaker:

and that incident response plan, just to wrap that thought up, doesn't

Speaker:

have to be everybody inside your organization, but somebody has to

Speaker:

be responsible for making the first, the first phone call and declaring it

Speaker:

an emergency and that kind of thing

Speaker:

Yeah.

Speaker:

And Curtis, going back to what you were saying about, okay, you should outsource,

Speaker:

I think even if the company was… had the subject matter experts in-house, it

Speaker:

still might be beneficial to still have a third-party incident response management

Speaker:

team on call just in case, like you may not know the latest and greatest of

Speaker:

what's going on or other things like that.

Speaker:

Or maybe you realize, "Hey, this is something that's like outside of my zone

Speaker:

of comfort." And just having someone else you could talk to, you can, spitball

Speaker:

ideas or thoughts around, and all the rest could be beneficial even if you

Speaker:

think you or your team is prepared.

Speaker:

Absolutely.

Speaker:

and

Speaker:

the…

Speaker:

so remember, while you're putting the fire out, you've also gotta keep the lights on.

Speaker:

So if you're a one-man shop or a, a shop that's already stretched thin

Speaker:

with resources, you need some backup so that when that incident happens, the

Speaker:

rest of the business doesn't shut down

Speaker:

I like that.

Speaker:

Yeah.

Speaker:

And so this is an idea of something that you could actually hand over

Speaker:

to a third party, so that you can, like you said, keep the lights on.

Speaker:

I like that.

Speaker:

I… earlier I made the comment that the bigger you are, the more likely

Speaker:

you are to have specialized people for each different, discipline.

Speaker:

I would say the opposite of that is also true.

Speaker:

The smaller you are, the more likely you're just gonna have one

Speaker:

person, and then your IRT is call Mike, just like Mike said, right?

Speaker:

or whoever it is, right?

Speaker:

There are, there are, companies, like Mike's that… But the idea is identify

Speaker:

who that is, create that relationship now, and so that you can just make a

Speaker:

phone call, during, during an incident.

Speaker:

Your insurance company will have a list of pre-approved vendors of

Speaker:

different skill sets, forensics, response, remediation support, all that.

Speaker:

So call them too, they're a good resource

Speaker:

And that would be something that would actually be potentially, I'm sure it's

Speaker:

gonna depend on your policy, potentially be covered by that, that, policy, right?

Speaker:

Yeah.

Speaker:

so here's one that I know that you're gonna wanna chime in on, Mike, and that

Speaker:

is, a relationship with law enforcement.

Speaker:

'Cause I know you're big on

Speaker:

For,

Speaker:

so

Speaker:

for sure.

Speaker:

Every incident that we work, we always ask if they're open

Speaker:

to, involving law enforcement.

Speaker:

there's a lot of benefit to that, and I'll cover those first, and

Speaker:

that is that they're gonna bring their exposure to similar incidents

Speaker:

at oth- in other organizations.

Speaker:

So how did this happen?

Speaker:

how did it go?

Speaker:

how did they recover?

Speaker:

did they pay the ransom?

Speaker:

How did that go?

Speaker:

Did they not pay the ransom?

Speaker:

What were the repercussions?

Speaker:

All that stuff law enforcement will share with you.

Speaker:

they will expect some collaboration.

Speaker:

"Hey, we, we're here, we'd like, a copy of that evidence also." 'cause

Speaker:

that's going to their case file and help them track down these bad guys.

Speaker:

and then tools, and possibly even solutions.

Speaker:

And a- an example of a solution would be company A gets hit with

Speaker:

ransomware, they paid the ransom, they got the decryption key, and then

Speaker:

you get hit with the same ransomware.

Speaker:

The FBI, as an example, may give you that ransomware key that the other company paid

Speaker:

for to see if it helps you you pay the ransom or before you spend a whole lot

Speaker:

of time trying to recover on your own.

Speaker:

one of the things that law enforcement does not do is guarantee that

Speaker:

they're gonna get your money back or that you're-- they're gonna

Speaker:

clean your data off the internet.

Speaker:

They don't do that.

Speaker:

and I've been in a lot of incidents where the, the victim said, "Yeah,

Speaker:

I'll work with law enforcement only if they help me get my money back or

Speaker:

they help me, they're gonna prosecute, they're gonna catch these bad guys."

Speaker:

they're not gonna sign up for that.

Speaker:

if they're able to, great, but they're not gonna, they're

Speaker:

not even gonna talk about it.

Speaker:

Mike, I know sometimes, there are restrictions in terms of I

Speaker:

know we've talked about on prior podcasts, like who you are allowed

Speaker:

to pay ransomware to depending on sanctions and other things like that.

Speaker:

Do you find that some companies are cautious to bring in, the

Speaker:

feds in order to help them out because of those sort of concerns?

Speaker:

No.

Speaker:

for a couple reasons.

Speaker:

One, paying the ransom is not something that you're probably gonna be able to

Speaker:

do on your own, that's simply because we don't, most of us, 99% of us don't

Speaker:

have, just extra Bitcoin laying around.

Speaker:

and so i- in a lot of organizations, your ransom isn't $10, it's,

Speaker:

hundreds of thousands of dollars or a million dollars or more.

Speaker:

And so now you've gotta go out and get, source your Bitcoin

Speaker:

for that amount of money, and that's very difficult and timely.

Speaker:

to source a million dollars in Bitcoin's gonna take you a- about a month, and

Speaker:

most ransomware gangs give you a couple of days, maybe 10 days at the most.

Speaker:

can… we've strung one out about 10 days, just the back and

Speaker:

forth trying to buy some time.

Speaker:

the other part of that is we're gonna engage insurance.

Speaker:

Insurance is the one that's gonna negotiate the

Speaker:

உம்

Speaker:

hopefully with their own negotiators, not a third party like the guy in

Speaker:

Canada that was actually working with ransomware guys and getting a cut of it.

Speaker:

I don't know if you heard that in the

Speaker:

Yeah

Speaker:

Yeah

Speaker:

but the insurance company's gonna deal with it.

Speaker:

So anyone other than you dealing with the ransom is gonna be responsible for making

Speaker:

sure that who they're paying isn't on the, the restricted payee list, the OFAC list.

Speaker:

and it, and that, that's tricky also 'cause, bad guy A is supported by bad

Speaker:

guy B, who has a shell company that's funded by someone on the OFAC list.

Speaker:

How in the world are you gonna know that?

Speaker:

Right

Speaker:

but involving law enforcement, they're not gonna get into

Speaker:

your transactional business.

Speaker:

They're looking at the technical aspects of the incident and what

Speaker:

happened and how they can help, and what information they can collect.

Speaker:

If you ask them, for help, with the ransom and ransom negotiation, they will help,

Speaker:

but they're not gonna inject themselves

Speaker:

Okay.

Speaker:

that

Speaker:

So it's not like the TV shows and movies where there's a kidnapping

Speaker:

and the FBI comes and they're like, "We will handle them. Drop." And then

Speaker:

they swarm everyone and all the rest, and things always end up going bad.

Speaker:

and the reason for that is because of their priorities.

Speaker:

that's a human kidnapping.

Speaker:

That is a priority.

Speaker:

They will take jurisdiction.

Speaker:

They will take lead on that investigation once it's reported to law enforcement.

Speaker:

Similarly, in an incident response, if your incident turns out to be part of

Speaker:

one of their priorities, like terrorist funding, terrorist activity, then yes,

Speaker:

they're gonna get a little bit more in your business because that truly does fall

Speaker:

in some of their focus areas, and they'll, they will wanna get more involved.

Speaker:

But at the same time, they're not just gonna start taking stuff and doing

Speaker:

stuff, but they will start asking a lot of questions and want some answers

Speaker:

Now earlier, M- Mike, you used the acronym, OFAC.

Speaker:

That's the Office of Foreign Assets Control, and they maintain a list

Speaker:

of basically entities, typically government entities, right?

Speaker:

and no, they're not government entities, right?

Speaker:

they're terror- They're basically businesses that are connected with, I

Speaker:

stuff

Speaker:

terrorist organizations.

Speaker:

Is that, is there a better name there?

Speaker:

Just bad stuff.

Speaker:

It's not all terror.

Speaker:

Yeah,

Speaker:

Yeah, bad stuff

Speaker:

yeah.

Speaker:

and paying people on that list is a crime.

Speaker:

or I guess I should say

Speaker:

We,

Speaker:

be a crime.

Speaker:

yeah, it can, be a crime

Speaker:

you can file an exception with the Treasury, but that takes time.

Speaker:

and you don't wanna do it after the fact.

Speaker:

You don't wanna pay it and then file the exception.

Speaker:

You wanna file the exception and then hopefully they'll fast-track

Speaker:

it, and there are some organizations that, that they will fast-track

Speaker:

it, but still it's days of…

Speaker:

And it's mo- most of these happen over the weekend, and so you're not gonna get your

Speaker:

exception in to somebody until Monday, and so you're already a couple days behind

Speaker:

is not one of those, better ask for forgiveness than ask for permission?

Speaker:

It's, yeah, it's not one of those, huh?

Speaker:

All right.

Speaker:

no.

Speaker:

Not unless you like wearing jumpsuits and flip-flops

Speaker:

So the final thing on our list is, of course, vendors, right?

Speaker:

the, you need to be aware of who it is from a vendor perspective

Speaker:

that you're gonna call.

Speaker:

You need to know, what vendors you're using, if this is part of your asset list,

Speaker:

the services that you're gonna be using because again, they are also going to be

Speaker:

experts in their particular discipline, and that Can come into, account quite

Speaker:

a bit during, during an incident.

Speaker:

about vendors, though.

Speaker:

One interesting question is I know you probably wanna use the same

Speaker:

vendors that you have, but say for instance, Curtis, you brought up the

Speaker:

point that, you need tel- 10 Dell servers, and the person is, they don't

Speaker:

have it available for two months.

Speaker:

As part of the vendors, do you start to reach out proactively to other

Speaker:

vendors who might be able to supply maybe not a Dell, but maybe a Lenovo

Speaker:

or some other system that could satisfy those needs, even though you may not

Speaker:

currently be using it, but at least so you have those contacts established?

Speaker:

Definitely falls

Speaker:

I agree with that.

Speaker:

category, right?

Speaker:

establish,

Speaker:

add one more thing on the vendors is don't just have a list.

Speaker:

Actually talk to them.

Speaker:

Yeah

Speaker:

call your vendor contacts and say, "Look, I know you're an 8:00 to 5:00

Speaker:

guy, but when I have a problem on the weekend, who do I call? Do y'all have

Speaker:

an incident response team? Do you have a hotline?" figure all that stuff out

Speaker:

today, because if you don't, you're gonna be calling Bob, and he's not

Speaker:

gonna answer his phone on Sundays or Saturdays or whatever it is, and you

Speaker:

may have to go to that fallback plan.

Speaker:

if you've put some thought, forethought into that, that's a great idea

Speaker:

And then just a final thing here is this needs to be a real list, right?

Speaker:

This is not just something, we sat around and we're like, "Yeah, we should

Speaker:

probably have legal there, and we should probably have…" This needs to be a

Speaker:

recorded, written down list of people.

Speaker:

And also, don't forget the deputies, by the way, right?

Speaker:

Because, Curtis is going on vacation, and, isn't gonna be answering his phone.

Speaker:

And,

Speaker:

assistant coach?

Speaker:

yeah, exactly, right?

Speaker:

and then also, now, then once you have the team, this is also what tabletop

Speaker:

exercises, which we've talked about quite a bit before, this is when you get

Speaker:

that team involved, just like you said, bringing in the insurance, the cyber

Speaker:

insurance people as part of that tabletop.

Speaker:

but you can't have the tabletop if you don't know who the team is.

Speaker:

Identify the team up front, and then, bring them in.

Speaker:

Any final thoughts, Mike?

Speaker:

My final thought is to make sure you train on it.

Speaker:

having everybody go, "Yeah, sign me up. I'll do that." once

Speaker:

a year, we're gonna do that.

Speaker:

Yeah

Speaker:

let's sit around a table or hop on a Zoom call.

Speaker:

I've done so many that are virtual now.

Speaker:

There's no excuse to not go through an hour or two once a year to make sure

Speaker:

that you've actually walked through a problem and gone, "You know what?

Speaker:

Maybe I'm not the right person for that," or, "The phone number I have

Speaker:

for that person isn't right," or, "That person left," or whatever it is.

Speaker:

Walk through it, and that's when you're gonna start to identify things that

Speaker:

need to be updated, changed, or added

Speaker:

Yeah, and, the other thing is, again, this is about fostering a sort of a,

Speaker:

of this, of cybersecurity, culture of, defense and, and keeping current on

Speaker:

the things that are happening, right?

Speaker:

you look at, just something as silly as what happened to me at

Speaker:

the beginning of this episode.

Speaker:

I was trying to find… I've got a list of topics that we

Speaker:

were supposed to be working on.

Speaker:

I haven't done this for a while.

Speaker:

We took a little break, and, suddenly, the tool that I've been using to

Speaker:

help me maintain that list, it changed how it worked in between,

Speaker:

and, I was caught flat-footed.

Speaker:

Don't do that.

Speaker:

Don't do that to yourself.

Speaker:

the more often you can do this, the more often you, you refresh

Speaker:

and you keep current on the way everything works, right?

Speaker:

and you keep your brain working.

Speaker:

And, what about you, Prasanna?

Speaker:

Any final thoughts about building your IRT?

Speaker:

No, I think you and Mike covered it.

Speaker:

The only thing I was gonna chime in on was like, yeah, thing-

Speaker:

this list shouldn't be static.

Speaker:

Your team sh- isn't static, right?

Speaker:

It is gonna be constantly evolving and changing.

Speaker:

As people come into the organizations, you start handling new types of incidents.

Speaker:

Maybe you start to expand beyond to different types of vendors.

Speaker:

So it's very dynamic and fluid, and so I think I liked what Mike said, at

Speaker:

least meet once a year to do tabletop exercise so then you can identify, like,

Speaker:

where are the gaps in your incident response plan and your team, so you can

Speaker:

start filling those out ahead of time.

Speaker:

I would say smaller, more frequent tabletops I think is better

Speaker:

than just one giant tabletop.

Speaker:

the, the pressure becomes, I think, too much when you do it just once a year.

Speaker:

fans of the podcast have heard me tell stories about the way we used to do

Speaker:

incident response back in the day, and I remember that being hell, right?

Speaker:

and, the, so the more often you meet and the more often you establish

Speaker:

just this, this idea that the purpose of a tabletop to learn,

Speaker:

to find out who screwed up, right?

Speaker:

Or who doesn't know this.

Speaker:

Technically it is to

Speaker:

Safe place.

Speaker:

it's… What's that?

Speaker:

It's a Safe place.

Speaker:

It's a safe place Yeah.

Speaker:

So right.

Speaker:

thanks guys for, chatting with me once again.

Speaker:

Thanks, Prasanna

Speaker:

Anytime

Speaker:

Anytime, Curtis, and don't worry, we'll get your stuff all together and we'll

Speaker:

figure out our topics for next time too.

Speaker:

You are forgiven.

Speaker:

All right.

Speaker:

That is a wrap

Speaker:

The Backup Wrap-Up is written, recorded, and produced by me, W. Curtis Preston.

Speaker:

If you need backup or DR consulting, content generation, or expert witness

Speaker:

work, check out backupcentral.com.

Speaker:

You can also find links for my O'Reilly books on the same website.

Speaker:

Remember, this is an independent podcast, and any opinions that

Speaker:

you hear are those of the speaker and not necessarily an employer.

Speaker:

Thanks for listening