Easy Agile Podcast Ep.26 Challenging the status quo: Women in engineering
"It was great to be able to have this conversation with Maysa and have her share her story. So many great takeaways." - Nick Muldoon
Join Nick Muldoon, Co-founder and Co-CEO of Easy Agile as he chats with Maysa Safadi, Engineering Manager at Easy Agile.
As a woman, growing up in the middle east and being passionate about pursuing a career in the world of tech, don’t exactly go hand in hand. Navigating her way through a very patriarchal society, Maysa talks about her career journey and how she got to where she is today.
Having the odds stacked against her, Maysa talks about challenging the status quo, the constant pressure to prove herself in a male-dominated industry, the importance of charting your own course and her hopes for the future of women in tech.
This is such an inspiring episode, we hope you enjoy it as much as we did.
Transcript
Nick Muldoon:
Hi, team. Nick Muldoon, co-founder co-CEO at Easy Agile, and I'm joined today by Maysa Safadi, who's an engineering manager here at Easy Agile. We'll get into Maysa's story and journey in just a little bit, but before we do, I just wanted to say a quick acknowledgement to the traditional custodians of the land from which we are recording and indeed broadcasting today, and they are the people of the Dharawal speaking country just south of Sydney and Australia. We pay our respects to elders past, present, and emerging, and extend that same respect to all Aboriginal Torres Strait Islander and First Nations people that are joining us and listening in today. Maysa, welcome. Thanks for joining us.
Maysa Safadi:
Thank you, Nick. Thank you for inviting me.
Nick Muldoon:
So, Maysa's on today. We're going to explore Maysa's journey on her career to this point, and I think one of the things that interests me in Maysa's journey is she's come from a fairly patriarchal society in the Middle East, and has overcome a lot of odds that some of her peers didn't overcome, and she's managed to come to Australia, start a family in Australia, has three beautiful children and is an engineering manager after spending so many years as a software engineer. So, Maysa, I'd love to learn a little bit about the early stages of your life and how you got into university.
Maysa Safadi:
I was born and raised in United Arab Emirates. I am one of nine. I have three brothers and five sisters. I'm the middle child actually. Dad and mom, they were very focused on really raising good healthy kids and more important is to educate all of their kids regardless if they are boys or girls. Started my education at schools there. When I graduated from high school, I end up getting enrolled in a college like what you call it here in Australia, TAFE.
Education in United Arab Emirates, it's not free. Being one of nine and having that aim and goal for my father to educate all of us. When it comes to education, it was two factors that play big part of it. Can dad afford sending me to that college or university? and then after I finish, will I be able to find a job in that field? One of my dream jobs, I remember growing up I wanted to be a civil engineer, and I remember my older brother, he's the second, was telling me it's good that you want to study civil engineering. Remember, you will not be able to find a job.
Nick Muldoon:
Tell me why.
Maysa Safadi:
United Arab Emirates, it's male dominated country. Civil engineering is a male dominated industry. If you are going to look for a job after a graduation, it is pretty much given to males and Emirati males first. So, kind of it needs to go very down in the queue before it gets to me, and to be realistic, sometimes you give up your dreams because you know that you are not going to have a chance later in life.
Nick Muldoon:
Oh, my gosh, this is demoralizing.
Maysa Safadi:
Unfortunately.
Nick Muldoon:
Okay,
Maysa Safadi:
So, the decision for me to get to engineering, it was, again, I couldn't really go to university because it was too expensive. My older sister had a friend who told her about this institute that they are teaching computers. When it came to mom and dad, they really told us, "Do whatever you want, study whatever you want, it is you who is going to basically study that field and you need to like it and you need to make sure that you can make the most of it." So, with that institute, it was reasonably okay for my dad to pay for my fees and they were teaching computers. I thought, "Yeah, all right, computers, it is in science field, right? I can't maybe study civil engineering, but I'm really very interested to know more about computers."
Nick Muldoon:
Similar, close enough.
Maysa Safadi:
Close enough. I end up getting enrolled and I remember the very first subject was fundamentals of computers or computer fundamentals, something like this, and I thought, "Yeah, all right, that is interesting," and I did really finish my education from there. After two years I ended up getting a diploma in computer science.
Nick Muldoon:
So, was this a unique situation for you or were most of your girlfriends from high school also going on to college?
Maysa Safadi:
It's unique actually, unique to my family. I'm not saying it's rare, you will find other families doing it, but it's not common. It is unique because, yes, most of the girls, if not all they go to school, it's compulsory in United Arab Emirate, but very small number of them pursue higher education. Pretty much girls, they end up finishing school and the very first chance to get married, they end up getting married and starting their own family. I remember-
Nick Muldoon:
And you've chosen a different path because-
Maysa Safadi:
Oh, yeah.
Nick Muldoon:
... yes, you have a family today obviously, but you established your career, you didn't finish school and get married.
Maysa Safadi:
I think I really give so much credit to mom and dad in that sense. They told us education is more important than starting a family or getting married. They said, "Finish your degree, finish your education, then get married." The other thing they said, "Do not even get married while you are studying because for sure you won't be able to finish it. Maybe because your husband wouldn't want you to finish it. Maybe you will become so busy with the kids and you will put it back." I remember actually so many times with my older sisters when someone, it's traditional marriage there, when some people come and propose to marry or to propose for their hands, my dad always used to say, "No, finish your education first."
Nick Muldoon:
So, this is interesting because I think your eldest was born when you went and actually continued education and got your master's, is that correct?
Maysa Safadi:
Yes. I got diploma in computer science. However, I always wanted a bachelor degree. I knew that there is more to it. I fell in love with computing but I wanted more, and always I had that perception in mind, "If I'm going to get a better opportunity, then I have to have a better certificate or education." So, I thought getting a bachelor degree is going to give me better chances. I was working in United Arab Emirates and saving money, and Wollongong University had a branch there in Dubai. So, I had my eyes on finishing my degree there. Eventually I end up enrolling at Wollongong University, Dubai campus, to get my bachelor degree in computer science.
Nick Muldoon:
So, just for folks that are listening along, Wollongong is the regional area of Australia where Maysa and I and many of our team live. So, University of Wollongong is the local Wollongong University that has a branch in Dubai.
Nick Muldoon:
So you were with University of Wollongong doing this bachelor degree, and how did you make the transition and move to Australia?
Maysa Safadi:
When I was studying at Wollongong University, Dubai campus, and was working at the same time to be able to pay the fees, I met my husband at work, and happened that he has a skilled migrant visa to come to Australia, coincident. So, I was thinking, "All right, he is going to go to Australia, he is a person that I do really see spending the rest of my life with. So, how about if I transfer my papers to Wollongong University here in Australia, finish my degree from here, while he gets the chance to live in the country, and then we can make our minds. 'Is it a place for us to continue our life here?' If not, it was a good experience. If good, that is another new experience and journey that we are going to take." So, we end up coming to Australia. I finished my degree from here.
Nick Muldoon:
What did you find when you arrived at Australia? How was it different from United Arab Emirates? How was it different for women? How was it different for women in engineering given what your brother had said about civil engineering in Dubai?
Maysa Safadi:
I had a culture shock when I came to Australia. Yes, I was in a country that.... male-dominated country, third world country, no opportunities for females, to a country where everything is so different. The way of living, the communication, the culture, everything was so different. When it comes to engineering, because I didn't really finish my degree in United Arab Emirate, so I didn't even get the chance to work in engineering though. However, knowing about the country and knowing about the way they take talents in, I knew I had slim chances. Now, coming to Australia and to finish my degree at the university, it was challenging. Someone from the Middle East, english is second language, being in computer degree where looking around me, "My god, where are the girls? I don't really see many of them around." And then, yeah, getting into that stereotype of industry or of a field where it is just only for males.
Nick Muldoon:
Yeah, so a bit of a culture shock coming across. I guess fast forward, you've spent a decade in software engineering and then progressing into engineering leadership. What was the change and how did you perceive the change going from a team member to a people leader?
Maysa Safadi:
I graduated from Wollongong University and I end up getting a job at Motorola as a graduate software engineer. In the whole team there was three females.
Nick Muldoon:
How big was the team?
Maysa Safadi:
How big was the team? It was around 20.
Nick Muldoon:
Okay.
Maysa Safadi:
Yep. There was the network team which had, I can't remember how many, but it was a different team. The team I was in, it is development team, and there was three girls in there, one of them another graduate that end up coming to the program and one that started a year before. Interesting, these two females, they are not in IT anymore. I really loved the problem solving, I really loved seeing the outcome of my work in people's hands because I was developing features for mobile phones. So, all was in mind then as an IC, how to become better at my work, how to learn more, how to prove myself to everyone that I'm capable as much as any other male in the team.
Nick Muldoon:
Do you think, Maysa, that that's something that you've had to do throughout your career to prove yourself?
Maysa Safadi:
Yes, yes. It's a tough industry. Really not seeing so many females it makes it hard because you look for role models that makes you think, "Oh, she made it. I can make it. If she's still in there, then I can learn from her." I missed all of that. I never had another mentor in my career or having even a female manager in all of the jobs I had before. So, always I was dealing with males, always I was trying to navigate my way to show them the different perspective I can bring. Even the subtle interactions I used to have with them giving me that, "You are not capable enough. You are not there yet. This is our territory. Why are you here?" All of these things, it does really, without you think about it, it does really sink your self-esteem and the self-worth when you are in industries like this. Yeah.
Nick Muldoon:
So, I'm conscious, you know are in this position now, you've kind of talked about you can't be what you can't see. If you can't see a woman that's a people leader and you're not reporting to one, then it's hard to see how you can become that. But, here you are, you have become that, and for our team here, you are one of the women leaders in the company, which is fantastic. So, I guess, what are the sorts of activities that you are undertaking to try and be present and be visible that you can be a woman people leader in the engineering field. I think it was earlier last month perhaps that you were at WomenHack in Sydney.
Maysa Safadi:
Yes, I've been-
Nick Muldoon:
What's WomenHack?
Maysa Safadi:
Okay. WomenHack, it is organization to bring diverse talented women intake together, to support them, to educate them, and not just only that, to try to connect them with other companies that they appreciate diversity and inclusion, and basically try to recruit... Pretty much, it is finding opportunities for women in tech, in companies that they do value the diversity.
Nick Muldoon:
Okay. So, I think it's interesting, I see these parallels here between your mom and dad that kind of went out on a limb and extended themselves financially to get six girls through a college and university education in the Middle East, and they were doing something that was perhaps fairly progressive at the time. You said it wasn't common. It sounds like WomenHack is bringing together more progressive companies these days, that are creating opportunities for women to get into leadership or even to accelerate their careers.
Maysa Safadi:
Yes, it is so pleasing to see the change that has happened over the years. When I reflect back in 2000, when I graduated and end up working in IT, and all of the behaviors, there was no knowledge or there was no awareness how much diversity is important, and they were not even aware that really females are really quitting the field or not that many females enrolls in the first place in degrees like computing or engineering. Even education through the school, no awareness was there. Then you see now the progress that is happening, more awareness is during school. Universities, they are trying to make the degrees or the fields more inviting for females and diversity. They are trying to bridge the gaps. So, many companies that are taking action to make it easier for females to be in the field and to progress in the field.
So, WomenHack, there are so many other groups like Women in Tech, there are so many companies that are allies to females in tech as well, where they are trying to really support and make their voice heard by other companies. Is as well all of the research and the science, are really proving that having diversity in teams, it is going to be more beneficial for the companies, for the teams, to have more engaging teams having these differences. So, yeah, there is a lot of awareness happening at the moment, and so many companies are trying to do something about it. I wish if that was early on.
Nick Muldoon:
Earlier in your career.
Maysa Safadi:
Earlier in my career, yes. So, many times I felt so isolated. So many times I was sitting back and saying, "Is it worth the fight?" Why do I have to work always twice as hard, to just only prove that I'm capable? Why does it have to be this way? Why I'm not equal?" That what actually made me change my career from IC to people leader. I didn't want to put other females... Being people leader wasn't just only for females, it was for me to voice, to be able to help pretty much. People leader to be able to help anyone in the field regardless if they are males or females. Moreso is to lead by example, is to be a role model for others, is to show others that if I can make it, then definitely you can as well, is to provide the support, it's to build that trust.
Nick Muldoon:
So, how can we, as an industry, I guess, how do we change... I'm reflecting on Iran at the moment, and the activities that have taken place over the last 60 days in particular, but really just more media coverage for hundreds of years of oppression of women. What do you hope, you being a people leader, a woman that's come from the Middle East, what do you hope for these young women and girls in our Iran over their trajectory? If we're still making a journey here in Australia, in a male dominated industry, what sort of hope do you have over the 20 years from here to 2040, for these women that are in the Middle East today and still haven't found a progressive society?
Maysa Safadi:
Politics. It's the game of power. Really hoping is the awareness to get there for these females in locked countries to know that there are better opportunities for them. They need to be stronger, they need to support each other, they need to empower each other. As much as it is easy said, it's not that easy done. However, all of that frustration that is built in them, it is surfacing from time to time. I'm really hoping for Iranian women, not just only Iranians, I'm really hoping for every woman in the world, regardless if it is a third world country or even if it is advanced country like Australia, is to always feel that they are worthy, is always to feel that they can have a voice, they can be part of life, and they are doing meaningful things.
Now, if they are raised in a way that always being told you are second, always being told you role only to get married and raise family, they will believe it themselves. So, it needs to come from women like us, leading by example, being role models, sending the awareness. Really media, we need to use the media very well so we can get to these people who are really locked in their countries now thinking that this is normal. It a lot of work needs to happen.
Nick Muldoon:
Well, that's an interesting observation. It is normalized for them, isn't it? So, look, reflecting on my own upbringing, I remember that my parents would always say you can achieve anything you put your mind to, but I could open up the newspaper, I could look on TV and I could see a host of people that were people that look like me, that is white males that were Australian, that were successful in business, and so I believed that I could do and be whatever I wanted to do and be. So, I guess, how do we get this message out? How do we tell your story more broadly to get this message out? That you can do whatever you put your mind to, you can achieve whatever you hope to achieve. There's something interesting for me to reflect on about the media piece that you're talking about.
Maysa Safadi:
Yeah, and I think the countries that they are advanced, the countries that they are really recognizing women more and more, they are more responsible in sending that awareness. They have to do more. It is basically, yeah, media, it is such an important thing. This is what people read everyday or watch everyday.
Nick Muldoon:
I guess, I'm conscious, like we're talking about half a world away in the Middle East, but you're actually involved in a community group here at home. What's that group that you're involved in and how's that helping women?
Maysa Safadi:
Yeah, I'm a board member for organization called Women Illawarra. It is run by women, for women. Basically this organization is to help women in domestic violence, it's basically to set them in the right path. It gives them services and it does educate them and even help them with the counseling, with legal support so they can get out of these situations. Make them believe that they can be part of this society, that they are important voice in the society, in the community, and they can really contribute and make an impact. So, by providing this education and this support, it is empowering these women to take matters their hand, and again, to really set the path for their own life and their own success. They need to take control back again, and yeah, even help their kids see their moms that they are really doing the right thing.
Nick Muldoon:
It's this interesting thread that comes through in your entire life story and your journey, that mom and dad wanted you to have an education so that you were empowered to chart your own course in life-
Maysa Safadi:
Yes.
Nick Muldoon:
... and here you are today, giving back to other women, trying to help them get an education and feel empowered so that they can chart their own course in life. I think that's fantastic. Thank you, Maysa.
Maysa Safadi:
Thank you.
Nick Muldoon:
What is your hope for women over the next 10 years? Because it sounds like we're on a trajectory, we're making progress in some countries, we're not making as much progress in other countries. What's your hope for 2030? What does it look like?
Maysa Safadi:
My hope for 2030, or my hope for... I really hope it is even five years, less than 10 years. My hope for 10 years is not to have conversations about how to reduce the gap between males and females, because by the 10 years time, that should be the way everyone operates. My hope in 10 years time is to have equal opportunities for anyone regardless what's their gender, background, language they speak, physical abilities, it needs to be equal, it needs to.... Equity, it is such an important thing. Giving exposure to the same opportunity, it is so important regardless what's your abilities. Stereotyping, I need that to get totally erased from the world.
We are all a human, we did not really choose where we born, who our parents are, what our upbringing, what our financial situation, it wasn't our choice, why do we have to get penalized for it? We have responsibility toward the world to help everyone. We are social people, we really thrive when we have good connections and good bonds, we really need to tap into the things that makes us better. So, we have so many talents that we can use it to the benefits of the world. I know countries always going to have fights and politics, that everyone is looking for the power, that's not going to disappear. But us, as people part of this world, we really need to try to uplift and upskill everyone around us. I really hope for the females in all of the other countries to know that they are worth it, to know that they are as good as anyone else. They have the power, they don't realize how much strength and power they have. So, it comes from self-belief. Believe in yourself, and you will be surprised how much you will be able to achieve.
Nick Muldoon:
There you go. Believe in yourself and you'll be surprised with how much you are able to achieve. Maysa Safadi thank you so much for your time. Really appreciate it.
Maysa Safadi:
Thank you so much Nick. Thank you everyone.
Related Episodes
- Podcast
Easy Agile Podcast Ep.1 Dominic Price, Work Futurist at Atlassian
"I had the pleasure of sitting down to chat with Dominic Price from Atlassian. It was so enjoyable to reflect on my time working at Atlassian and to hear Dom's perspective on what makes a great team, how to build an authentic culture and prioritising the things that matter."
- Nick Muldoon, Co-CEO Easy Agile
Transcript:
Nick Muldoon:
What I was keen to touch on and what I was keen to explore, Dom, was really this evolution of thinking at Atlassian. I remember when we first crossed paths, and correct me if I'm wrong, but I recall it was like late 2014, I think.
Dom Price:
Yeah, it was.
Nick Muldoon:
Scrum Australia was on at the time, and you're at the George Street offices above Westpac there, wherever, and we had Slady in the room, there was yourself. I think Mairead might have been there, I'm not too sure.
Dom Price:
No, probably not. I think it was JML's engineering meeting, engineering relationship meeting.
Nick Muldoon:
Right.
Dom Price:
Involved in the
Nick Muldoon:
Hall of Justice, right? Not Hall of Justice.
Dom Price:
Not Hall of Justice. Avengers.
Nick Muldoon:
Avengers. When was the last time you were in Avengers?
Dom Price:
A long, long time ago. A long, long time ago.
Nick Muldoon:
You've been working from home full-time since March, right?
Dom Price:
Yeah. Although, actually for me I can work from anywhere for three and a half years.
Nick Muldoon:
Yeah, fair enough. Okay.
Dom Price:
The shift for me was missing the work element. I'm missing the in-person work element because being on the road a lot, having that one day or two days week in the office, there's connective tissue, I didn't realize how valuable that was. Going five days work from home is not a great mix to me.
Nick Muldoon:
No, not a great mix for me either, Mate. I was the one that was coming into the office during lockdown. I was like, "Oh." It was basically an extension of my house, I guess, because I was the only one that was coming in. But I could turn up the music and I could get some work done without-
Nick Muldoon:
Yeah. All right. Back in late 2014 when we first crossed paths, we're at JML's engineering meeting, and that was before JML had gone to Shopify.
Dom Price:
Yes.
Nick Muldoon:
We were talking about all things. I remember talking about OKRs, which was the Objective Key Result framework that we were using at Twitter that I think Atlassian was looking at for the first time.
Dom Price:
Yeah, we'd been flirting with for a while.
Nick Muldoon:
Flirting with for a while. What was Atlassian using at the time? What was VTFM?
Dom Price:
There was two things we had at the time. VTFM which was Vision, Focus Areas, Themes, and Measures, which was our way of communicating our strategy, our rolling problem strategy. But then off the back of that we had what I would call old school KPIs. Right? We'd pick goals, right, we'd pick ways of measuring those goals, but very KPI-focused and very red, amber, green scoring focused. When we were small, it worked okay. It didn't scale particularly well because it became punitive. If you were green and you hit your score, you got ignored because you were always meant to, and if you were amber or red and you missed by anything, you got punished. Right? It's like, "Please explain." You got the invite to the head master's office.
Dom Price:
We wanted a way of getting stretched into there and also be more outcome-focused, because I think when we scaled KPIs, we got very output-focused like, "What did you do this week? What's the thing that you shipped?" Actually, the thing that we forgot about, and I think it was by accident, it wasn't bad intent, but we forgot about what's the outcome or impact we're trying to have on the customer, because that happens after the event. OKRs were a way of putting stretch in there and building the idea of moonshots and big ambition. But then also, refocusing us on, what is the impact we're trying to have on the end customer, not just what's happening in the sausage factory?
Nick Muldoon:
With that end customer perspective though, did you get that with the VTFM?
Dom Price:
No. Actually, the first year we rolled that OKR, that was part of the problem. We had the VTFM because that stayed, right? That was like the sacred cow for the first year. That stayed, and we just had OKRs underneath. Yeah, and we're like, "Well-
Nick Muldoon:
So you're mixing them together.
Dom Price:
... which ones do we report? The measures in the VTFM because that's our Atlassian level plan, or the OKRs, which is the things we're actually doing and the impact that we're having. You're like, "Well, both," and you're like, "Well, they don't meet. There's no cascade up or down, left or right, that had them aligned properly." The year after we actually phrased ... we got rid of the VTFM, and we now have our rolling 12-month strategy phrased as OKRs.
Nick Muldoon:
Right. Okay. At that time, Dom, back in 2014, when you were flirting with OKRs, as you said, was the VTFM that you were working to replace, was that company, department, team, individual, or did it just stop at the team?
Dom Price:
Yeah. That's where it didn't really scale, right? The organizational one made sense, and again, when you're smaller, it's a lot easier to draw the linkage between your team or your department and the company one. As we scaled, what happened was we'd have a company level VTFM, and then each department would go and build its own. The weird thing is, and again, this works for a phase, and then you realize it doesn't, is we don't create value up and down the org. We create value across the organization, and so building these VTFMs in departments was honing our craft. But it was doing it at the detriment of how you work across teams.
Dom Price:
I think that it's one of those things that at the time, we didn't realize. If I had a crystal ball, it would have been great. But it seemed like the right thing to do. Engineering had a VTFM. So did Design, so did Product Management, and you're like, "You know we only ship one experience, right?" I don't care if engineering's perfect and design's not because that's letting the customer down because this one experience that we shipped. There was this whole sort of arbitration where we'd build them vertically, and then try and glue them together horizontally, but they'd all been built in isolation.
Dom Price:
Then When it comes to trade offs, and every business has trade offs, whether you admit it or not, when you're like the best laid plans literally stay on paper, right? That's where they exist, then reality kicks in one day after you've built the plan. When reality kicks in, what trade off are you going to make? Are you going to do the trade off that delights the customer, maybe compromises you? Right? then how do you do that internally? Are you going to help Design and Product Management and load balance that way, or say, "Well, yeah, I'm an engineer and we're fine. It's Design's fault. How we'd adapt everyone is Design's fault." We quickly realized that a vertical model brought about some unintended consequences and some odd behaviors that weren't really the kind of behaviors we wanted as Atlassian.
Nick Muldoon:
Back in that time, Dom, in 2014, 2015, did you have the triad then with the product design and later for each of those groups?
Dom Price:
In physical people, yes.
Nick Muldoon:
But in-
Dom Price:
... modeling, no.
Nick Muldoon:
No. Okay. How did that come to fruition, that triad where they were working as one in harmony to deliver that customer experience?
Dom Price:
I think essentially, it's one of those brilliant mistakes when you look back. We're really good at reflecting, and you do a few reflections, and you suddenly see the pattern, and you like, "Hey, our teams that are nailing it are the ones where we've got cognitive diversity and the balance of skillsets." Not where we got one expert or one amazing anything, but actually, you're like, "Yeah, actually -
Nick Muldoon:
If look at some of these patterns-
Dom Price:
Yeah. You're like, "Hey, I just saw that design." They get the product manager in a headlock and have a valid argument at a whiteboard. You're like, "I actually like that. That's what I like, the meeting where there's consensus and violent agreement." Maybe that's the wrong signal, right, that the right signal is this cognitive diversity, this respectful dissent. You see that, and we're like, "Hang on, we have the realization that engineers build great usable products, and product managers are thinking about the whole sort of usability and along with the designers. Viability, you're like, "Oh, we need all three. All three of those need to be apparent for a great experience." You're like, "Cool. Let's double down on that." Right?
Dom Price:
We started to hone in a lot more on how do we get the balance across those? How do we understand the different roles? Because we didn't want to become homogenous. You don't want those three roles to get on so well they all agree. You also don't want to violently disagree all the time, right? A little bit of disagreeing commits great. If they're always in disagreement, then that comes out in the product. How do you find the things that they stand for, and how they bring their true and best selves to each phase? Right? If you think about any given product or project, there are natural phases where their skillsets are more honed, right? In the phases for us, part of managing design is often a lot better with the ambiguous and a whole lot of stuff. When it comes to building, I'm probably going to listen to the engineer more, right?
Nick Muldoon:
And you're handing it over to delivery.
Dom Price:
Yeah. But then also, it's like, well, it's not the ... If you think about delivery time, I think we'd sometimes think of it as the relay race. I think that's incorrect, because everyone's still going to see the relay race. Once I've run my lap, I'm done, right? But in product development, it's not because when I hand over the baton, I still have a role. Even if it's in build phase, the product manager and the designer still have a massive role. It's just that they're co-pilots and the engineer's the pilot, right? You don't disappear, your role changes. I think that was one of the nuances that we got as we started to bring in the right skills, the right level of leadership, the right level of reflection to go, "How do we balance this across those phases, and how do we be explicit on what role we're playing in those different phases?
Nick Muldoon:
Okay, that's interesting. I'm going to want to come back to that when we turn our attention to the customers in the Agile transformation landscape more broadly. But one thing that has got me thinking about with respect to this balance is the fact that Atlassian had the discipline to hire for a triad, right? If I think about, I think this was around 2013 at Twitter, and in one of our groups, we had pick a number, but there would have been 200 people, and there would have been less than 10 product managers. I think we actually had a ratio of like 20. It was something silly like 26 engineers to a product manager. It wasn't even a design counterpart necessarily for each of the product managers. The balance was way off, and it wasn't very effective. Was there a time at Atlassian where there was this reflection? Because I'm just trying to think, in my time at Atlassian, I don't think we had maybe a great balance. I think there was a much heavier in engineering than there was in design and product.
Dom Price:
Yeah, it's one of those things that if it's not there, you don't miss it. Right? It's weird, right? It was a lot of it before my time, but when I listened to the story, it's like even design as a discipline when I started in 2013 was a very small discipline. I think even then, it was kind of like a hack to the notion where it was like, "Oh, yeah, we got some designers. They do the pixels, right? They make stuff look pretty." .
Nick Muldoon:
They do T-shirts and they do like .
Dom Price:
Who knows, right? But it makes us look pretty, right? They drink craft beer, and they sit on milk crates. We had this archetype of a designer, and then you like, "Oh, actually, once you start to understand user experience, the integration points, design languages, design standards, and the experience, once you get your first few designers who say, "Here's how our products fit together," and this is the experience from a customer lens, you're like, "Oh, I'm not sure I'm a fan of that." It wasn't badly designed, but nor was it particularly well-designed. Once you start to make some improvements, then you start to measure customer satisfaction, and you make that experience more seamless, you suddenly see the value.
Dom Price:
I think for Atlassian, I think we started as an engineering company. We added product management, and then begrudgingly added design. Interestingly, in my time there, the most recent thing we've added is research.
Nick Muldoon:
Yeah. Okay.
Dom Price:
Fascinating evolution for us again to go, "What do you mean, research? I'm a product manager. I know everything about the industry in the section of the competition." They're like, "But do you know anything about the customer, and the job to be done at the top tasks, or how they experience, and thinking about things like accessibility, thinking about how our products integrate with other products, thinking about not just from a competitive landscape, but what's the actual job to be done, and what are the ways people are trying to do that, and the drop off points.
Dom Price:
Research has become a new muscle that we had the exact same experience with. First time you roll it out, people are like, "Oh, we don't need that. It's overkill." You're like, "I see, it's really quite good." Hard to integrate because you're giving me findings I wasn't expecting, and then there was a shift both for designers, but also for the product managers to go, "Oh, I can use a resource now because you're this independent group that can help me understand, not just my product and iterating on my products, but a level up, what's the thing that my products trying to do? Who am I competing with, and what does that experience look like end to end?" It's a completely different lens.
Nick Muldoon:
Basically what you're describing there, Dom, is you've still got the triad of the product design and leads. But now you've got this. It's a centralized kind of research team?
Dom Price:
Yeah.
Nick Muldoon:
Do they drop in for particular projects in different areas?
Dom Price:
Yeah. If you think about it, if you strip it back to plain common sense, I think over time, we got really good at explore and build. But maybe we lost a little bit of the muscle around wonder. These researches are great. The blinkers are out and they wonder, right? I'm sure they physically do this as well, but mentally, they stroll, right? They go quite broad, and when they come back with their insights, you're like, "Wow, that's given me a really good broad perspective." I'll give you a quick example where we're working a lot, and we always are on accessibility. It's easy to look at your current products and start adding stuffing. Right? That's the logical way of doing it. Or you look at your competitor's products, and how do you become a pair or a peer? Easy.
Dom Price:
What our research team did was they actually got a whole lot of people with different sight and mobility issues, and said, "We're going to now get you to use our products and go through some key tasks." They're already using it, but it's like maybe they're on a screen reader, or maybe they can't use a mouse, they can only use keyboard shortcuts. You suddenly see the experience through their lens, and we record it, and it's tracking eye sight and line of sight using all the actions. You've got this level of detail there where you're like, "Well, I know we're trying to build empathy, but actually seeing that experience firsthand is completely different than trying to think about it."
Dom Price:
You just seeing it through the lens of this person. The research team did weeks and weeks and weeks of research with different users, different backgrounds, different disabilities, different products and different tasks to give all of our teams the sense of what is it like as the actual person. Here, you can actually walk in that person's shoes, or it feels like you are.
Nick Muldoon:
If you're a product manager and a designer, and you're ... Because it sounds to me, Dom, like that sort of investigation or exploration that you're describing there with respect to mobility-impaired or sight-impaired people, that's something that it might be hard for me to bring that into my OKRs for our product. For that triad, how do I have ... I'm trying to push forward and chase down monthly active users, or cross-flow, or whatever it happens to be, and that's much more long-running. It's like it's a long-running thread that's just going to stay open for 18 months while we think about this stuff and have these conversations. Does that research group, do they actually have their own OKRs, and are those OKRs annually?
Dom Price:
Yeah. Yes and no. We do mostly OKRs across design, research. We now have a ways of working team. They tend to be shared OKRs or more cross-functional, are cross-functional to shared. The cross-function as in we have the same objective, but different key results.
Nick Muldoon:
Yeah, okay.
Dom Price:
If you think about accessibility as an objective, the research team, their key result is about having the latest greatest research and insight so that we can learn and understand. You're like, "Cool, that's your task." Right? The design team, your OKR is to take that insight and turn it into some designs, usability, and then you can actually go along the value chain, and each different person in that value chain has a different OKR.
Nick Muldoon:
Okay. Still today though, there's no OKRs at an individual level, right? It's all team, group-based?
Dom Price:
We have odds and sods. I've dabbled with it a little bit. Sometimes I think I've always got individual OKRs. The question is whether I share them or not. I think if you think about the majority of knowledge workers, they will have individual goals, "I want to learn a new skill, I want to acquire a new "
Nick Muldoon:
Honing the craft.
Dom Price:
Yeah, right? Whether you write that down and it benefits you or not is not up for debate. When it came to writing them down in a collective, having a single storage of them, any kind of laddering, I think the cost of that is higher than the benefit. Right?
Nick Muldoon:
Okay.
Dom Price:
We strayed away from saying everyone then must have individual OKRs, and then ladder, whatever, because it ends up getting very, very cumbersome, and actually very command and control. What we've done instead is really say to our leaders, and this is leadership by capability, not by title, but saying to our leaders, "This is part of a conversation you should be having on a regular basis with your people around growth, and how you're inspiring them, and how you're motivating them. How are they developing and evolving? What are the experiments they're running on themselves? Right? How are they with other people? What are their challenges, and how can you help them never get those challenges? What are their points of amplification that you should be calling out with them to turn the dial on that? Right? What are their superpowers that we should be really encompassing, right, and nailing?" That's part of a leadership conversation. Does that need to be written down and centralized? No. To me, it becomes a zero benefit to documenting that.
Nick Muldoon:
It's interesting hearing you describe that. That's very much learning and development-focus. If I think back to Andy Grove's High Output Management, my understanding of that at an individual ... of OKRs and an individual level was always with respect to your customers. What am I going to do for my customers? But you've actually framed it, what am I going to do for myself that's going to allow me to be in better service to my customers, maybe next financial year?
Dom Price:
Yeah. It's a secret. I'm guessing this is shared by Atlassian, but this is definitely my view of the world, and I've shared this with enough people now where they understand. You can't be a great teammate if you're not turning up your true best self. You got to take a step back. There's this whole weird narrative around the humility of being a teammate where you're like, "I'm a martyr, and I'll take one for the team." It's BS, because if you're not in the right zone for that team activity, you're not giving your best, right? You're actually the anchor that brings the team down. You step back from that and you say, "Well, how do you be the best?" Because not all work is teamwork. There's a lot of deep work and individual tasks and stuff that needs to be done. You're like, "Right, I need to be the best version of me. Well, what's that mean?"
Dom Price:
It means that before any meeting, I need to have done my tasks, or before any meeting, I need to have done my pre-meeting, right? If we're meeting as a team and we have this synchronous activity, what are the things I need to do to be best prepared for that synchronous activity to deliver the most value? How can I get the most out of that teamwork? How do I turn up and be present? How do I turn up with respectful dissent and challenge, right, and provocation? That requires me first to be an individual. Right? I think one of the dangers in a lot of work environments right now is people have lost the understanding of what it is to be an individual, what your key leadership style, your learning style, how do you turn up? Right? How do you critique? How do you take feedback? All these things that make you you, you need to know those and be aware of them before you can be great in a team environment.
Dom Price:
It's not just the tasks. You need to know you. If you're a great individual, and you've honed that, you can then be a great teammate, and if you're a great teammate, you can deliver great outcomes for your customers. Anything else is an accident, right? We've all been in accidental teams, which has delighting a customer, and we've sat there and gone, "Really not sure what I did to that guy. I'll take it. I'll take the pat on the back. I'll take the kudos, and the bottle of wine, and the congratulations. Not really sure I amplify that. I don't know. If you don't know, you probably didn't. Right? That's not humility. You're probably just a passenger. I think the danger in growth environments is there's lots of passengers who they're a passenger to lots of success, and after a while, they're like, "I'm amazing." You're like, "You're not. You've just been in the right place at the right time repeatedly."
Nick Muldoon:
I got to process that.
Dom Price:
Let me give you an example. Right? A couple years ago, I was in New York with a mate of mine, Sophie. She's unofficially mentored me and helped me a lot of the years, right? I'm talking to her about trying to scale me, and I was really angry about some stuff, and thankfully, it was late afternoon in New York. She bought me [inaudible 00:25:30]. We smashed a drink and we chatted away, and she's one of those people that just calls BS on you, right? I'm like, whinge, whinge, whinge, whinge, whinge. She's like, "Oh, cool." She's English as well. She's like, "So I'm guessing you're just going to whinge about it and hope it goes away." I'm like, "All right, fair point. Little bit, my English came out. I actually hoped that maybe even if I did whinge long enough, it would actually disappear." She's like, "That never happens, does it? What are you going to do about it?"
Dom Price:
We chatted when she gave me this challenge, and she's like, "You're not evolving." She's like, "You're adding stuff in, but you're full." She's like, "Cognitively, Dom, you're full." My challenge was I was reading all these business books at the time, and I knew lots of stuff, but I didn't feel any smarter. I wasn't doing anything with it, and it's creating this frustration spiral. She gave me the exercise, and you've probably seen this, the four Ls. She got a bit of paper, and she's like, "All right, write the four Ls down. Reflect on you as a leader. This is selfishly purely about you as a leader. Last 90 days, what have you loved? What have you done personally?"
Dom Price:
I'm like, "Oh, no, no, no, no." She's like, "Not like, because we're not doing likes here, right? We're not being soft. Loved, and own it. Actually, superpower, do more of it." We did that, very uncomfortable few sips of wine. Then she's like, "What's your loathe and what's your longed for?" I had lots of long fors, long list of those, but no loathed. She's like, 'All right, here's the problem. The long for, you're sprinkling in in the 25th hour of every day. No wonder you're not doing well at it, because you never giving it the ... You're not giving yourself any space, or time, or freedom to actually experiment. You're not growing. You're not getting better. You're just adding stuff in." I'm like, "Fair point."
Dom Price:
We went through, found some loathe. She's like, "Right, you're going to remove those. Who are you going to tell those habits, or rituals, or whatever, who are you going to tell that you're removing those because they need to hold you accountable? Because they'll slip back in really easily." I found someone, pinged them. She's like, "Right, the longed." She's like, "I need to let you know that when you add them in, you're going to be crap at them." I was like, "I don't want to be rubbish at anything. I'm a leader. I need to be a superhero. I need a cape, and I need to fly in, and everything must be perfect first time." She's like, "No, the first time you added a longed for, the chances are you'll be rubbish at it. Find someone who has that muscle and let them help you practice it, and you'll get better at it over time."
Dom Price:
Then the fourth L was what have you learned? What experiment did you learn yourself last quarter? What did you learn about yourself?" She's like, "Right, go and tell as many people as you can. That'll build a place where you're learning and networking environment for you." I did it, and then I did it again 90 days later. There's a few times when the power of rationalization kicks in, and I just BSed myself because really easy to do. Then other times where I've got really deep and analyzed on it, and it's enabled me every 90 days to evolve, right? Now, the moral of the story, and this is where we tie individual to team, the number of leaders I know in big businesses driving transformations, but they're not changing themselves. What behavior are they rolling with? They're rolling with the behavior of, "I'm fine. You're not. You all need to change," which is-
Nick Muldoon:
Yeah, role modeling status quo.
Dom Price:
Yeah.
Nick Muldoon:
Yeah. That's interesting. I've certainly heard of the love versus loathed exercise. I like that you, or that Sophie extended it to longed for and learned. I think that's really beautiful, and I'll take that. With the loathe in particular, were there things on that list that you had to delegate or you had to hire someone to do? Because there's things that I think about that I loathe with respect to the business, and typically, they're things about orchestrating, paying suppliers, or whatever it happens to be. How do I address that? I bring the bookkeeper into the business that-
Dom Price:
Yeah. The little game that we played is you're not allowed to outsource it until you drop it. Right? The idea is, you're going to find a way of dropping it first, because maybe it doesn't need to exist, right?
Nick Muldoon:
Okay.
Dom Price:
Because you've worked at big companies, and you walk around a big company, and you're like, "That person there, they only exist to do a task that someone probably could have automated or got rid of," but they didn't have the time. Also, they put a warm body in the way. Then you add another warm body, another warm body, and you suddenly realize you've got thousands of warm bodies keeping this deck of cards stacked together, and if one card falls, the entire thing comes tumbling down. I removed stuff that I was really uncomfortable removing stuff. I was like, "This is so important." It wasn't. My blinkers were just off, right? Then she's like, "We'll stop doing." She's like, "It's not life or death." She's like, "No, thanks, Dom. Well, you're not a surgeon, so stop doing something, and listen, and see what happens when you stop doing it." I'm like, "Oh, no, but these are really important. People will be angry. I'm a very important person." You remove something and no one bloody notices. You're like, "Why have I been doing this?"
Nick Muldoon:
Why was I doing it? Yeah.
Dom Price:
Yeah. Then I-
Nick Muldoon:
Can you-
Dom Price:
One of the big examples for me was meetings. This wasn't a delegate or [inaudible 00:30:24]. This was me just being a control freak, and turning up in meetings where I wanted to be there just in case. We looked at my condo, just a sea, I use Gmail, right, the sea of blue of all these meetings, double booked, triple booked. She's like, "Right." She's like, "Imagine you've got to set yourself a goal of getting rid of 15 hours." I'm like, "What? It'd be easy to create a time machine that adds 15 hours a week. I can't remove 15 hours of meetings. I'm a very, very important person." Then we played this game called Boomerang or Stick. I declined every single meeting, and I sent a note saying, "This is either a boomerang," in which case it comes back, or if it's a stick. When you throw a stick, it doesn't come back. The boomerangs, I want to know what the purpose of the meeting is, what my role is in the meeting, and what you're going to hold me accountable for.
Dom Price:
Two thirds of the meetings didn't come back. Right? The ones that did, I honestly admit to you, I was playing the exact wrong role in virtually all of them. It was funny because I get these emails back and they're like, so one of this meeting I was in, they were like, "Your role is the decision maker." In the next meeting I was like, "I need to apologize. I thought I was the protagonist." Every time they were suggesting something, I'm like, "Well, you could do that, or these three things." I was sending them into a complete spiral, and they were like, "You're a terrible decision maker." I'm like, "No, I'm a good decision maker when I know that's my job because this isn't your title. Your title stays-
Nick Muldoon:
Ah, Dom.
Dom Price:
... the same, right? Your title stays the same, but your role's different in every environment, every engagement, your role is different. We don't call it out, we just assume. Once we clarified those assumptions and realized I've got them all wrong, the meetings I was in, I was way more effective in. Two thirds of them didn't come back. Either the meeting [inaudible 00:32:09], or it didn't need me in that. If you think about it, and me and you know this, our most precious resources are time.
Nick Muldoon:
Time. Yeah.
Dom Price:
Why are we giving it away for free or for negative cost? Right? I'm like, "No, I'm growing all that stuff back."
Nick Muldoon:
Liz and I have been having this conversation for a while now about statistically speaking, I've probably got 50 years left on earth, based on how long a Caucasian Australian male lives. But I've probably only got 40 good, usable years left, because then you kind of like atrophy and all that.
Dom Price:
Yeah.
Nick Muldoon:
Yeah. Liz and I have been going, "Well, if we've only got 40 summers left, what are we going to do with 40 summers?" It's a really good exercise to bring you think real quick, what do you want to be spending your time on?
Dom Price:
Yeah. Absolutely. It's the same thing. You can do that at a meta, macro level for life, and I think you can do it on a annual quarterly basis. With work, there's so many things that we just presume we need to do, and both the four Ls and just my attitude has enabled me to challenge those and go, "Well, I just say why an awful lot right now." So it's like, "I'd like you to come to this meeting." I'm like, "Oh, cool. Why?" They're like, "I don't know. I'd like you there." I'm like, "But why? Because if you can't explain to me what you want me to do, then you probably don't need me there."
Nick Muldoon:
Five whys, right? Five whys.
Dom Price:
But also the reason I'm often asking them why is I'm like, "You do know I'm a pain in the ass when I do come to the meeting, so just I want to double check to you, you really want me there. Because if you converged on an idea and you want to ship it, don't invite me. All right, I'm the wrong person." Just challenging on that and getting that time back, and then using it for things that are way more valuable. I rebalanced my portfolio just like a financial advisor or a market trader rebalances a financial portfolio every quarter, I did the same thing with me. If I don't, then what I'm saying is when I don't do that, I'm saying the version of me last quarter is more than good enough for them for next quarter. What I'm saying is-
Nick Muldoon:
Yeah, which is never the case, is it?
Dom Price:
Yeah, I'm saying the world's not changed. The world stayed flat, right, and everything's going on a flat line. That's not the case. If I'm not evolving myself at the same pace as Atlassian or our customers, then I've become the anchor by default. I'm the anchor that slows us down.
Nick Muldoon:
Tell me, what portion of your time today are you spending with customers? Because I know over the years in our conversations, I think about a lunch we had at Pendolino, you, Dave, and I, probably two and a half, three years ago now, but we were talking a lot about Agile transformations at the large end of the spectrum. How much time are you spending with customers today, and what are those conversations like?
Dom Price:
Yeah. I'm probably over the 50, 60% mark right now, but mainly a rebalance again. When COVID hit, the conference scene disappeared, and so I'm like, "Cool, I get to reinvest that time. I could reinvest it internally at Atlassian, and I did do it where we're evolving our ways of working internally and driving some change there. I got involved in that, made sense. But I was like, "Hey, our customers are struggling." First of all, we need to understand how and why they're struggling, and then if we can help them, find a way of helping them. It's funny how the conversation really changed from quite tactical, yeah, 18-month plans and presumed levels of certainty, to going, "Hey, the world's changed. The table flip moments just happened. Our business model has been challenged, our employees are challenged. We're having these conversations about people, wellness, and actually, we've said for years we care about our people, but now we actually have to. What does that mean? All the leaders just trying to understand the shift from peacetime to wartime-
Nick Muldoon:
To wartime.
Dom Price:
... to time peacetime. I think that it's funny that the transition from peace to wartime, I think the shared burning platform, the shared sense of urgency, I think a lot of these transition, they're okay. I wouldn't say they're amazing, but they weren't awful given that mostly the Sydney in Australia haven't manage through wartime. Right? We've had an amazing economic success for a long time. The harder bit, the way more complex bit is going from war to new peace, because new doesn't look the same as old peace. Right? It's a very different mindset to go-
Nick Muldoon:
Who is-
Dom Price:
... about managing in wartime is I don't need approvals because it's a burning platform. We just drive change, just do it, just do it. New peace is different because we're like, "Well, how long's this going to last for? What are the principles I want to apply? How do I build almost from a blank piece of paper?" Very different mindset.
Nick Muldoon:
Was that Ben Horowitz with the hard thing about hard things where he talked about war versus peacetime leaders?
Dom Price:
I've read it in a few things. The most recent one I read-
Nick Muldoon:
Hear different places.
Dom Price:
... in was General Stanley McChrystal. He wrote Team of Teams.
Nick Muldoon:
Okay.
Dom Price:
He did one on demystifying leaders and how we've often put the wrong leaders on a pedestal, and there's some great leaders out there that just didn't get the credit because they were way more balanced. But yeah, there's a few different narratives out there on it.
Nick Muldoon:
With the latest that you're meeting with, I guess, well, one, are they using something like the four Ls that Sophie shared with you?
Dom Price:
Yeah, that's become a lot more popular, I mean, certainly with C-suite and the level down, even board members, actually. When I share that, there's this kind of moment of reflection of going, "Yeah." It's because I get them with the irony of going, "Question one, are you driving a transformation?" They're like, "Yes." You're like, "Cool. Are you transforming yourself?" "No." By the way, reading a Harvard Business Review article on Agile doesn't mean you're evolving yourself. That means you're educating yourself. That's subtly different. We've all read the article. It doesn't make you an expert, so sit yourself down. That is the first moment of getting them bought in.
Dom Price:
Then the second one is just saying to them, "Just be honest right now, what are the things you're struggling with?" For a lot of leaders, it's this desire that they get the need for empathy, vulnerability and authenticity, they get it because they've read it. They understand it, they comprehend it, they find it really hard to do. Right? A lot of them are leaving as a superhero leading through power and control. They've led through success, but they're not led through a downturn and a challenging time, and they're just questioning their own abilities. There's a lot of, I don't even want to call it imposter syndrome, I think there's a lot of people just saying, "I think my role as a leader's just changed, and I don't know that I understand the new version." That's quite demoralizing for a lot of people. It's quite challenging.
Dom Price:
The irony being is that the minute they look to that and talk about it, they've done the empathy, vulnerability, and authenticity. They've done the thing they're grasping for. But instead, they're trying to put this brave face on it. In a lot of organizations, I've seen a lot of ruinous empathy. A lot of people buffering from their team, like, "Nick, I don't want to tell you that bad things are happening in the company, because I don't want you ... I think you're already worried, because I won't tell you that," without realizing that you fill in the gaps, and you think way worse things than I could ever tell you. The information flow's changed, and then for a lot of leaders, the mistake I've seen on mass is they have confused communication and broadcast. Right? Communication is what I hear and how I feel when you speak. Broadcast is the thing that you said. Because of this virtual world, there's lots of loom, and zoom, and videos, and yeah, we're going to broadcast out.
Nick Muldoon:
Broadcast a lot. Yeah.
Dom Price:
But we're getting to listen for the response.
Nick Muldoon:
This has to be a very challenging time for a number of leaders today, but 2018 or 2008, there were a lot of leaders back then that probably, I presume, picked up a lot of scar tissue around GFC. How many of the leaders that you're chatting with today would have picked up scar tissue through the GFC, and they're still finding this kind of a feeling, at least, like it's uncharted territory?
Dom Price:
Well, and that's, I think, the byproduct. I was going to say problem. The byproduct of the Australian system is we've dodged the bullet in 2008. Economically, we did not get the same hit that the rest. The stock markets got a little hit, and a whole lot of other things took a little bit of a dip, but nowhere near that the size or magnitude of the rest of the world. Both through the mining boom, yeah, the banking sector, a whole of other tertiary markets around tourism doing well at that time, you're like it was a blip, but it wasn't a scar. I think that's where there's a lot of countries have got that recent experience to draw upon, like, "Here's how we do this. Right? Here's how we bunker down. Here's how we get more conservative. Here's the playbook for it." I think a lot of countries haven't got that playbook, so they're getting at it, right? They're doing it on the fly. I think there's that.
Dom Price:
But also I think this one's just different. The global financial crisis was a financial and market-caused issue, right? This is a health pandemic-caused market downturn. I don't think we've got a playbook for that, because we don't know the longevity of it. -
Nick Muldoon:
If you-
Dom Price:
Go on.
Nick Muldoon:
Yeah. No, sorry, Dom, I was just going to ask, if you cast your mind back to GFC, were you anxious going through GFC? Have you been anxious this year?
Dom Price:
No. I wasn't anxious at all through GFC because it felt like ... I did a recession in the UK a long, long time ago, and so I've been through that downturn. I've worked in companies that had downturns, even if the general economy was fine, and industries that had shrunk, where at the end of each quarter you're like, "Right, we talk about the books. Who are we letting go? What projects are stopping?" It was always the taking away, not the adding. I've been through that. The thing that made me anxious about 2020 was, this is the first time I think we've had this level of uncertainty. It's funny because a lot of people talk about change fatigue. I actually think humans are quite good at change. I think we actually do that quite well. But uncertainty, we are terrible with.
Dom Price:
It's weird how when we get uncertainty, how different people respond in different ways. Some like to create a blanket of certainty and wrap it around them like, "Now, here's what I know, and this will come true." You're like, "Maybe [inaudible 00:42:16]." I like your blanket, it's comfortable. But it's not necessarily real, right? It's not going to shelter you from the things that we genuinely don't know about. This is where agility has become key, or nimbleness has become key because if I look at the leaders in the companies that are listening, they're actually attentive to their customers and listening, they're the ones that are evolving really quickly, because they've got ... not only have they got the nimbleness as the muscle, but they're listening to cause correct. The ones that have ... think they've rolled out agility in the last few years, but never added the customer bit, they've got small, fast, nimble teams just running around in circles.
Nick Muldoon:
They're not heading in a particular direction. Yeah.
Dom Price:
Yeah. They are clueless, right, because without that overarching like, "Why are we doing this? And that customer that we care for, we still care for, how's that customer's world changed? Right? Because if that customer has changed, how can we change with them?" A lot of companies haven't done that yet, and I think it's some are holding the breath and hoping for the best. Some are just too fixated on, "But we have a plan, and if we stick to that plan," I read a book somewhere that said, "If you stick to a plan, you'll be fine." You're like, yeah, the world just shifted around you. Your plan might not be as relevant.
Nick Muldoon:
It's making me think, Dom, about the Salesforce transformation, Agile transformation in 2006. That was one of the big bang, I think it was one of the early big bang Agile transformations that took place. I don't know if it was Parker Harris or how it actually played out, but the leaders of Salesforce basically said, "You're going to change to Agile. You're going to give this thing a go. Otherwise, all is lost." There's been other examples. I think shortly after, LinkedIn did their IPO. They pulled the end on call, they stopped everything to rework how they work. Is 2020 one of those years? Are the best companies going to take advantage of this as an opportunity to retool how they work? Then the other companies are just going to kind of atrophy and slowly decline over the next five?
Dom Price:
I think the best ones probably built some of the muscle already, the ones that are now reacting, right? I think if you are aware of the market, all COVID's done is put an accelerant on the stuff that was changing anyway. Right? Yes, it's not ideal, but it's stuff that was happening regardless, right? I think we really had five or 10 years to equip ourselves, and we got given three months instead. I think a whole lot of companies that saw those patterns emerging, changing people habits, technology, practices, ways of working, customer demand, experience demands, you put all those together, that's why Agile transformation has been a massive hit for the last three, four, five years, right? The ones that were prepared for that are awesome. The ones that responded quickly, that are like, "Brilliant, don't let a crisis go to waste. What can we do?" They'll do well. The ones that have dug their heels in and are being stubborn ,saying the world will return to normal and it's just a matter of time, they're the ones that I fear for, because that atrophy that may have been a slow decline, I think that becomes a cliff. Right? Because in a consumer-
Nick Muldoon:
Slow decline, and then they just fall off the edge at some point.
Dom Price:
consumer world, consumers spending goes down, sentiment goes down, and relevance suddenly becomes really important. Is your product relevant to your customers? The people that understand that, and then have agility in how they deliver it, that's a winning combination. I think the interesting, I was talking to a friend about this on the weekend because they were like, "What's the difference between the successful ones and the not successful ones?" It's hard to pinpoint a single reason. But the one that stands out for me is the Agile transformations that have been people-centric are the best. A whole load of them were tool-centric or process-centric. I will send all my people on a training course. I'm going to make you agile, I'm going to give you some agile tools. Go. You're like, "Did you change their mindset? Did you change their heart? Did you change the things that they're recognized for, their intrinsic motivations? Did you change those things?" Because if you didn't, their inner workings are still the same, right? You've just giving them some new terminology.
Nick Muldoon:
I think that's a really, really, really good point. I go back to if I cast my mind back to the first Agile conference that I went to over a decade ago, the conversation back then was very much around training the practices, teaching the practices to your people, and then it evolved into a tooling conversation. But again, teaching the practices and software are just tools, and it was probably 2013, 2014, I guess, when the modern Agile movement came out, and they were talking a lot about psychological safety. Go back to where we started the conversation, right?
Dom Price:
Yeah.
Nick Muldoon:
Psychological safety, bring your whole self to work, and that will free you and enable you to do something tremendous for your customers. Give me a sense of the customer conversations that you've had throughout 2020. What percentage do you think have psychological safety, truly have that psychological safety?
Dom Price:
Yeah. I have to remind myself that psychological safety isn't an all or one, right? It's a sliding scale. I would say it's improved, where it's done with authenticity. The danger is, it becomes a topic where people are like, "I was working from home. There's an increased chance of stress, it's a whole of a change. Things are going wrong. Oh, I know what, let's just talk about psychological safety a lot." You're like-
Nick Muldoon:
That's not it.
Dom Price:
... "There's no correlation between talking about and doing." Right? It becomes the topic, right, the fashion, right? Just like wellness and mindfulness have become fashionable to talk about, doesn't mean we've got any better at it. And so that-
Nick Muldoon:
But isn't that the thing, Dom? Agile was the fashionable thing to talk about, and so we talked about it, but nothing really changed in a lot of these organizations.
Dom Price:
Yeah. It's not dissimilar with psychological safety. What has happened though is over time, the leaders that are truly authentic, vulnerable, build that environment where you can bring your best self, and they appreciate the respectful dissent, but they will still, at the right time, disagree and commit. They're like, "Nick, I heard your view. Thank you for sharing. Our only decision at this point, we're going down Path A. I know that you're in Path B. We're going down Path A. When we leave this room, we commit to A." I hear you. You want me when we're coming to A, and here's the signals we'll assess to make sure it's the right path. If it's not, we'll course-correct. Those people are thriving in this environment, and more people want to work with them. What this environment has done is it's shone a massive light on the difference between managers and leaders. Managers manage process and they like control. Right? Leaders are about influence and people.
Nick Muldoon:
Do you think, so the fact that people are working remote and working from home, that's made it easier to see who the leaders are.
Dom Price:
Yeah, it's shone a light on-
Nick Muldoon:
Because the managers are just trying to count time.
Dom Price:
Yeah, count time, but they're also thrashing around busy work, because they're like, "I'm the manager. I need to show that I'm doing something. I would manage tasks in and around the office, and what I meant some people to do. If we're autonomous, and they just do it, then what's my role?" You suddenly start seeing business. This noise comes out of them, which isn't, "Here's an outcome I achieved, or here's how the team's doing on team cohesion or bonding." They're not talking about about big meta level things. They're sharing these transactions with you, and you're like, "I assumed you're always doing the transactions. Now, you're showing me them all. It's a bit weird." Right? It's just a behavior, right? We must have a process for that. Well, what's the process? You're like, "Actually, what about the process of common sense?" Right?
Dom Price:
If you think about pre-COVID, most organizations that would allow people to work from home once or twice a week had a giant process and policy about how you apply to work from home that one day a week and everything, and then suddenly they're like, "Well, actually, we can do that. Everyone's going to go work from home." But now things have settled down a bit, the process police and the policy police are coming back again going, "But what about, what about? We pay Nick to do 40 hours a week, and what if he didn't do 40 hours?"
Nick Muldoon:
40 hours a week.
Dom Price:
Who cares? Nick delivered his outcomes and his customers are over the moon. As long as he's not doing 80 hours and he's not burning out, doesn't matter? Right? The idea of 9:00 to 5:00, Monday to Friday as a construct is being challenged. The idea of you needing to sit at a physical desk for eight hours a day to do your work, when actually at least half of your tasks you can do asynchronously, that's been challenged. But for the managers who want manage process and control, they're like, "But if Nick can work from anywhere, and we trust him to do the right work, what do I do? I'm his manager. You're like, "You could inspire him. You could coach him, mentor him. You can lead him, you can help him grow, you can do a whole lot of stuff. Just don't manage his tasks for him. He's quite capable of managing a to-do list." It's challenging that construct again. For a lot of people, that's uncomfortable because that's a concept that we've just stuck with for years.
Nick Muldoon:
This is going to lead to a lot of change. I guess I've been thinking with respect to remote, Dom, I've been thinking much more about the mechanics of remote work and logistics around pay scales, and geographic location, and pay, and all this sort of stuff. But you're really opening my eyes to a whole different aspect. There are, in many large organizations, there are a lot of middle managers, and if these roles are no longer valuable, what do all these people do, and how do we help them find something that they love and that they long for? Because presumably they've not longing for-
Dom Price:
Yeah, that's the thing.
Nick Muldoon:
... task management.
Dom Price:
Yeah, yeah. They're probably not deeply entrenched in that as being something they're passionate about, right? It's just like they found themselves in this role. This is the interesting thing. If you look at rescaling, I've been looking at rescaling for a few years as a trend, right? How do we look at the rate of change in both technology, people practice, whatever else? That means that we're all going to have to rescale, right? The idea of education being up until the age of 21, and then you're working 45 years doesn't exist, right? So lifelong learning. You look at that, and you go ... Amazon did a great example last year. Bezos and Amazon put aside a billion dollars to retrench a thousand people that they were going to dispose. Right?
Nick Muldoon:
Yeah, yeah, yeah.
From their warehouses, right?
Dom Price:
Yeah, yeah. They're on automation to displace those people. What was came out recently and said, there's I think, it's like 1,500 people who will be displaced because they're going for fully autonomous distribution centers. They're looking to retrain those people and redeploy them elsewhere. You're like, "Cool, how are we doing that?" The reason I mentioned it is I think we assume it for low skilled, high volume tasks, because that's associate what we've associated with technology disruption in the past. But if you think about it, there was I think about a year and a half ago, McKinsey had a report called The Frozen Middle Layer. It was about how this frozen middle layer was going to thaw and be exposed, right, as these middle managers. There's thousands of them. That phrase, the middle layer, COVID just poured the icing on that. Right? [inaudible 00:53:26]. They're all going, "What? Me? No, no, I've only got 10 years left in my career. Let me sit here, manage a few tasks. I'll take inflationary pay rise every year. I won't cause any trouble." You're like, "I don't know. You can retrain here."
Dom Price:
These people haven't been engineered to think about retraining before. They've been engineered to think about comfort and conservatism and safety. I think we need to appreciate that they still have value in the workplace. I just don't think it's the old value. For them, the four Ls-
Nick Muldoon:
This is going to be a huge shock to this frozen middle layer, as McKinsey called it. I think about so we're Wollongong, Port Kembla. We're in a working class, steel town, and over the course of, pick a number, over the course of 25, 30 years, 20,000, 22,000 people have been let go from the steelworks and they're been told to retrain. I'm sure a portion of them do, but a lot of them that are older, like you're talking about someone that's in their 50s that's got 10 years on their career, right, they probably just took early retirement, and maybe they found something else to do in the community, whatever it happens to be. What are the structures that we provide for this huge crew of people to get them re-skilled in our businesses so that we don't lose the tacit knowledge and get on to the next thing? How's Atlassian thinking about this?
Dom Price:
It's also about front-loading it, right? We have to hold our head in shame as a general society, how light we leave it. When I hear stories about those steelworks closing down, and you're like, "Why are we surprised by that? Why are we surprised when Holden stopped developing cars in Australia? Really? But really, you're surprised?
Nick Muldoon:
We saw it coming.
Dom Price:
Yeah.
Nick Muldoon:
We propped up the car industry in Australia for 35 years.
Dom Price:
Yeah. You put tariffs on anyone importing to make your own industry look good, and then those tariffs go away, people are looking for cheaper. Unfortunately, we signed up for a global economy, right? It's a borderless business model that we're in, and whether you like that or not, it's what we signed up for. The reality is instead of reacting each time this happens when it's normally too late, how can we respond? How can we use these brilliant algorithms and data managing to go, "Here are world economic forum future skills, here are large employers, here are other skillsets about people." You try and give that out, and you're like, "These are the ones most at risk, and they're at risk over the next 18 months." Cool. Start retraining them now, but not when they're out of the job when they go, "Well, now, I'm out of my job. Now, what do we do?" You're like, "I don't know. Buddings? I don't know."
Dom Price:
We've got way more data and insights than we probably give ourselves credit for. I think one element is front-loading it, and the next one is saying, "How do we not recreate this problem again?" If you look in the US right now, the largest employer, not by company, but by job type is driver.
Nick Muldoon:
Okay. Yeah, by role. Yeah, yeah, yeah.
Dom Price:
By role, right? So Uber driver, truck drivers, manual drivers, people behind the wheel driving a vehicle. Where's billions of dollars worth of investment going in, Google, Amazon and every other? Right? Autonomous vehicles. You're like, "Cool."
Nick Muldoon:
Autonomous vehicles. Get rid of all those people?
Dom Price:
If I-
Nick Muldoon:
What are we doing to reskill those people?
Dom Price:
Yeah. Or even better, what are we doing in our education system to say, "How do we help people coming through the education system be more resilient with their future skills? I don't like the idea of being able to future-proof people. I don't think we've got a crystal ball, so let's part that. But how do we make people more resilient in their skills, well, all the skills we think will be required? World Economic Forum do great research every few years and publish it, and then I look at the education system, and I'm like, "That was built in 1960. We're tuning kids out that if you talk to.
Nick Muldoon:
Hey, hey, hey, Dom, okay, okay. I'm getting anxious at the moment. Let's end on a high note. What are things that make you optimistic for the next decade? All right? In 10 years time, how old are you going to be in 10 years time? Like 45 or something?"
Dom Price:
52.
Nick Muldoon:
52?
Dom Price:
Yeah.
Nick Muldoon:
Okay. Oh, yes.
Dom Price:
Getting old.
Nick Muldoon:
Yeah, okay. Yeah, okay. Okay, so when you're 52, what are you looking forward to over the next decade? What's exciting?
Dom Price:
There's a couple of things we need to realize, right? Very first thing we need to accept is our future is not predetermined, it's not written, and it's not waiting for us. Right? We design it and define it every single day with our actions and inactions. As soon as we have that acknowledgement, we don't sit here as a victim anymore and wait for it to happen to us. We go, "Oh, oh, yeah." Then like, "We have to decide on the future. No one else does. We collectively do." That's the first step. You're like, "Oh, I've got way more say in this than I ever realized." The second one is, we need to drop a whole load of stuff around productivity, and GDP, and all these things that we've been taught are great measures of success, and just be happy and content in life. If you've got four years left, I've probably got 30 something years left, I want to enjoy those 30 years. I have no vision of being buried in a gravestone somewhere with, "Dom was productive."
Nick Muldoon:
Dom, this is great. What we've got to do for society over the next 10 years is get society out of KPIs and into OKRs.
Dom Price:
Yeah.
Nick Muldoon:
Right?
Dom Price:
And get a balance out of going, "How ... This is what I've learned from COVID, right? You know this, I did 100 flights last year. I did a few at the start of the year and trip to the UK in the middle of COVID. But I've not traveled since June. Now, admittedly, the whole work from home thing, I'm going insane a little bit, but the balance of life, like sleeping in my bed every night, hanging out with friends, meaningful connections, right, actual community. I've lived in the same apartment for three years, and it took COVID for me to meet any of my neighbors, and it took COVID for me to meet the lovely ladies in the coffee shop downstairs. I'm like, "I've lived above you for three years, and it's only now you've become a person." Right?
Dom Price:
There's so much community and society aspects we can get out of this. The blank piece of paper, if you imagine this as a disruption that's happened to us, and there's no choice, and we can fight against it, that the options we have to actually make life better afterwards. Whether it be four-day working week experiments, or actually working from anywhere means that a whole other disabled, or working parents can get access to the workforce. Funny, if you get more done. Unemployment in the disabled community is 50% above that of the able-bodied community, not because of any mental ability, just because it's hard for them to fit .
Nick Muldoon:
Logistically. Yeah.
Dom Price:
You've just changed that, right, with this crazy experiment called COVID. If we start to tap into these pockets of goodness, and actually, we sees this as an opportunity to innovate, right, and I hate the P word of pivot, but forget pivoting, to genuinely innovate, what might the world look like, and how can we lean into that? How do we get balance between profit, and planet, and people, and climate, and all those things? If we do that, we've got a chance to build this now and build a future we want that we're actually proud of. I think the time is now for us to all stand up because it's not going to happen to us ... Or it will happen to us. If we choose to do nothing, it'll happen to us. It doesn't need to. I'm really excited because I think we're going to make some fundamental changes and challenges to old ways of working and old ways of living, and we'll end up happier because of it.
Nick Muldoon:
Don, I'm super jazzed, man. Thank you. I really appreciate your time today. That's a great place to finish it up.
Dom Price:
I hope some of those things come true.
Nick Muldoon:
Okay. I hope some of those things come true, right? I feel like the things that are in our power, the things that we can directly affect, takeaways for me, I've got extending the love and loathe into the love, loathe, long for and learned. I think that's great. I also like the boomerang versus the stick with respect to your time and what's on the calendar, and just jettison the stuff that is, well, it's not helping you, or the teams, or anyone else. Yeah.
Dom Price:
You could do it like [inaudible 01:01:33]. If it ends up being important, you can add it back.
Nick Muldoon:
Sure.
Dom Price:
[inaudible 01:01:38].
Nick Muldoon:
The big takeaway from this conversation for me is that it's in our hands. The choice, we make the decisions. It's in our hands. I think about, was Mark Twain, whether you think you can or whether you think you can't, you're right.
Dom Price:
Yeah. Yeah.
Nick Muldoon:
You might as well think you can and get on with it.
Dom Price:
Yeah, yeah, give it a red-hot stab and see what happens.
Nick Muldoon:
All right, cool. Don, thanks so much for your time this morning. Really appreciate it.
Dom Price:
It was great chatting.
- Podcast
Easy Agile Podcast Ep.12 Observations on Observability
On this episode of The Easy Agile Podcast, tune in to hear developers Angad, Jared, Jess and Jordan, as they share their thoughts on observability.
Wollongong has a thriving and supportive tech community and in this episode we have brought together some of our locally based Developers from Siligong Valley for a round table chat on all things observability.
💥 What is observability?
💥 How can you improve observability?
💥 What's the end goal?
"This was a great episode to be a part of! Jess and Jordan shared some really interesting points on the newest tech buzzword - observability""
Be sure to subscribe, enjoy the episode 🎧
Transcript
Jared Kells:
Welcome everybody to the Easy Agile podcast. My name's Jared Kells, and I'm a developer here at Easy Agile. Before we begin, Easy Agile would like to acknowledge the traditional custodians of the land from which we broadcast today, the Wodiwodi people of the Dharawal nation, and pay our respects to elders past, present and emerging, and extend that same respect to any aboriginal people listening with us today.
Jared Kells:
So today's podcast is a bit of a technical one. It says on my run sheet here that we're here to talk about some hot topics for engineers in the IT sector. How exciting that we've got a couple of primarily front end engineers and Angad and I are going to share some front end technical stuff and Jess and Jordan are going to be talking a bit about observability. So we'll start by introductions. So I'll pass it over to Jess.
Jess Belliveau:
Cool. Thanks Jared. Thanks for having me one as well. So yeah, my name's Jess Belliveau. I work for Apptio as an infrastructure engineer. Yeah, Jordan?
Jordan Simonovski:
I'm Jordan Simonovski. I work as a systems engineer in the observability team at Atlassian. I'm a bit of a jack of all trades, tech wise. But yeah, working on building out some pretty beefy systems to handle all of our data at Atlassian at the moment. So, that's fun.
Angad Sethi:
Hello everyone. I'm Angad. I'm working for Easy Agile as a software dev. Nothing fancy like you guys.
Jared Kells:
Nothing fancy!
Jess Belliveau:
Don't sell yourself short.
Jared Kells:
Yeah, I'll say. Yeah, so my name's Jared, and yeah, senior developer at Easy Agile, working on our apps. So mainly, I work on programs and road maps. And yeah, they're front end JavaScript heavy apps. So that's where our experience is. I've heard about this thing called observability, which I think is just logs and stuff, right?
Jess Belliveau:
Yeah, yeah. That's it, we'll wrap up!
Jared Kells:
Podcast over! Tell us about observability.
Jess Belliveau:
Yeah okay, I'll, yeah. Well, I thought first I'd do a little thing of why observability, why we talk about this and sort of for people listening, how we got here. We had a little chat before we started recording to try and feel out something that might interest a broader audience that maybe people don't know a lot about. And there's a lot of movements in the broad IT scope, I guess, that you could talk about. There's so many different things now that are just blowing up. Observability is something that's been a hot topic for a couple of years now. And it's something that's a core part of my job and Jordan's job as well. So it's something easy for us to talk about and it's something that you can give an introduction to without getting too technical. So we don't want to get down. This is something that you can go really deep into the weeds, so we picked it as something that hopefully we can explain to you both at a level that might interest the people at home listening as well.
Jess Belliveau:
Jordan and I figured out these four bullet points that we wanted to cover, and maybe I can do the little overview of that, and then I can make Jordan cover the first bullet point, just throw him straight under the bus.
Jordan Simonovski:
Okay!
Jess Belliveau:
So we thought we'd try and describe to you, first of all, what is observability. Because that's a pretty, the term doesn't give you much of what it is. It gives you a little hint, but it'll be good to base line set what are we talking about when we say what is observability. And then why would a development team want observability? Why would a company want observability? Sort of high level, what sort of benefits you get out of it and who may need it, which is a big thing. You can get caught up in these industry hot buzz words and commit to stuff that you might not need, or that sort of stuff.
Jared Kells:
Yep.
Jordan Simonovski:
Yep.
Jess Belliveau:
We thought we'd talk about some easy wins that you get with observability. So some of the real basic stuff you can try and get, and what advantages you get from it. And then we just thought because we're no going to try and get too deep, we could just give a few pointers to some websites and some YouTube talks for further reading that people want to do, and go from there. So yeah, Jordan you want to-
Jared Kells:
Sounds good.
Jess Belliveau:
Yeah. I hopefully, hopefully. We'll see how this goes! And I guess if you guys have questions as well, that's something we should, if there's stuff that you think we don't cover or that you want to know more, ask away.
Jordan Simonovski:
I guess to start with observability, it's a topic I get really excited about, because as someone that's been involved in the dev ops and SRE space for so long, observability's come along and promises to close the loop or close a feedback loop on software delivery. And it feels like it's something we don't really have at the moment. And I get that observability maybe sounds new and shiny, but I think the term itself exists to maybe differentiate itself from what's currently out there. A lot of us working in tech know about monitoring and the loading and things like that. And I think they serve their own purpose and they're not in any way obsolete either. Things like traditional monitoring tools. But observability's come along as a way to understand, I think, the overwhelmingly complex systems that we're building at the moment. A lot of companies are probably moving towards some kind of complicated distributed systems architecture, microservices, other buzz words.
Jordan Simonovski:
But even for things like a traditional kind of monolith. Observability really serves to help us ask new questions from our systems. So the way it tends to get explained is monitoring exits for our known unknowns. With seniority comes the ability to predict, almost, in what way your systems will fail. So you'll know. The longer you're in the industry, you know this, like a Java server fails in x, y, z amount of ways, so we should probably monitor our JVM heap, or whatever it is.
Jared Kells:
I was going to say that!
Jordan Simonovski:
I'll try not to get too much into-
Jared Kells:
Runs out of memory!
Jordan Simonovski:
Yeah. So that's something that you're expecting to fail at some point. And that's something that you can consider a known unknown. But then, the promise of observability is that we should be shipping enough data to be able to ask new questions. So the way it tends to get talked about, you see, it's an unknown unknown of our system, that we want to find out about and ask new questions from. And that's where I think observability gets introduced, to answer these questions. Is that a good enough answer? You want me to go any further into detail about this stuff? I can talk all day about this.
Jared Kells:
Is it like a [crosstalk 00:08:05]. So just to repeat it back to you, see if I've understood. Is it kind of like if I've got a, traditionally with a Java app, I might log memories. It's because I know JVM's run out of memory and that's a thing that I monitor, but observability is more broad, like going almost over the top with what you monitor and log so that you can-
Jordan Simonovski:
Yeah. And I wouldn't necessarily say it's going over the top. I think it's maybe adding a bit more context to your data. So if any of you have worked with traces before, observability is very similar to the way traces work and just builds on top of the premise of traces, I guess. So you're creating these events, and these events are different transactions that could be happening in your applications, usually submitting some kind of request. And with that request, you can add a whole bunch of context to it. You can add which server this might be running on, which time zone. All of these additional and all the exciters. You can throw in user agency into there if you want to. The idea of observability is that you're not necessarily constrained by high cardinality data. High cardinality data being data sets that can change quite largely, in terms of the kinds of data they represent, or the combinations of data sets that you could have.
Jordan Simonovski:
So if you want shipping metrics on something, on a per user basis and you want to look at how different users are affected by things, that would be considered a high cardinality metric. And a lot of the time it's not something that traditional monitoring companies or metric providers can really give you as a service. That's where you'll start paying insanely huge bills on things like Datadog or whatever it is, because they're now being considered new metrics. Whereas observability, we try and store our data and query it in a way that we can store pretty vast data sets and say, "Cool. We have errors coming from these kinds of users." And you can start to build up correlations on certain things there. You can find out that users from a particular time zone or a particular device would only be experiencing that error. And from there, you can start building up, I think, better ways of understanding how a particular change might have broken things. Or some particular edge cases that you otherwise couldn't pick up on with something like CPU or memory monitoring.
Angad Sethi:
Would it be fair to say-
Jared Kells:
Yeah. It's [crosstalk 00:11:02].
Angad Sethi:
Oh, sorry Jared.
Jared Kells:
No you can-
Angad Sethi:
Would it be fair to say that, so, observability is basically a set of principles or a way to find the unknown unknowns?
Jordan Simonovski:
Yeah.
Angad Sethi:
Oh.
Jess Belliveau:
And better equip you to find, one of the things I find is a lot of people think, you get caught up in thinking observability is a thing that you can deploy and have and tick a box, but I like your choice of word of it being a set of principles or best practices. It's sort of giving you some guidance around these, having good logging coming out of your application. So structured logs. So you're always getting the same log format that you can look at. Tracing, which Jordan talked a little bit about. So giving you that ability to follow how a user is interacting with all the different microservices and possibly seeing where things are going wrong, and metrics as well. So the good thing with metrics is we're turning things a bit around and trying to make an application, instead of doing, and I don't want to get too technical, black box monitoring, where we're on the outside, trying to peer in with probes and checks like that. But the idea with metrics is the application is actually emitting these metrics to inform us what state it is in, thereby making it more observable.
Jess Belliveau:
Yeah, I like your choice of words there, Angad, that it's like these practices, this sort of guide of where to go, which probably leads into this next point of why would a team want to implement it. If you want to start again, Jordan?
Jordan Simonovski:
Yeah, I can start. And I'll give you a bit more time to speak as well, Jess in this one. I won't rant as much.
Jess Belliveau:
Oh, I didn't sign up for that!
Jordan Simonovski:
I think why teams would want it is because, it really depends on your organization and, I guess, the size of the teams you're working in. Most of the time, I would probably say you don't want to build observability yourself in house. It is something that you can, observability capabilities themselves, you won't achieve it just by buying a thing, like you can't buy dev ops, you can't buy Agile, you can't buy observability either.
Jared Kells:
Hang on, hang on. It says on my run sheet to promote Easy Agile, so that sounds like a good segue-
Jess Belliveau:
Unless you want to buy it. If you do want to buy Agile, the [crosstalk 00:13:55] in the marketplace.
Jared Kells:
Yeah, sorry, sorry, yeah! Go on.
Jordan Simonovski:
You can buy tools that make your life a lot easier, and there are a lot of things out there already which do stuff for people and do surface really interesting data that people might want to look at. I think there are a couple of start ups like LightStep and Honeycomb, which give you a really intuitive way of understanding your data in production. But why you would need this kind of stuff is that you want to know the state of your systems at any given point in time, and to build, I guess, good operational hygiene and good production excellence, I guess as Liz Fong-Jones would put it, is you need to be able to close that feedback loop. We have a whole bunch of tools already. So we have CICD systems in place. We have feature flags now, which help us, I guess, decouple deployments from releases. You can deploy code without actually releasing code, and you can actually give that power to your PM's now if you want to, with feature flags, which is great.
Jordan Simonovski:
But what you can also do now is completely close this loop, and as you're deploying an application, you can say, "I want to canary this deployment. I want to deploy this to 10% of my users, maybe users who are opted in for Beta releases or something of our application, and you can actually look at how that's performing before you release it to a wider audience. So it does make deployments a lot safer. It does give you a better understanding of how you're affecting users as well. And there are a whole bunch of tools that you can use to determine this stuff as well. So if you're looking at how a lot of companies are doing SRE at the moment, or understanding what reliable looks like for their applications, you have things like SLO's in place as well. And SLO's-
Jared Kells:
What's an SLO?
Jordan Simonovski:
They're all tied to user experiences. So you're saying, "Can my user perform this particular interaction?" And if you can effectively measure that and know how users are being affected by the changes you're making, you can easily make decisions around whether or not you continue shipping features or if you drop everything and work on reliability to make sure your users aren't affected. So it's this very user centric approach to doing things. I think in terms of closing the loop, observability gives us that data to say, "Yes, this is how users are being affected. This is how, I guess the 99th percentile of our users are fine, but we have 1% who are having adverse issues with our application." And you can really pinpoint stuff from there and say, "Cool. Users with this particular browser or this particular, or where we've deployed this app to," let's say if you have a global deployment of some kind, you've deployed to an island first, because you don't really care what happens to them. You can say, "Oh, we've actually broken stuff for them." And you can roll it back before you impact 100% of your users.
Jared Kells:
Yeah. I liked what you said about the test. I forgot the acronym, but actually testing the end user behavior. That's kind of exciting to me, because we have all these metrics that are a bit useless. They're cool, "Oh, it's using 1% CPU like it always is, now I don't really care," but can a user open up the app and drag an issue around? It's like-
Jess Belliveau:
Yeah, that's a really great example, right?
Jared Kells:
That's what I really care about.
Jess Belliveau:
The 1% CPU thing, you could look at a CPU usage graph and see a deployment, and the CPU usage doesn't change. Is everything healthy or not? You don't know, whereas if you're getting that deeper level info of the user interactions, you could be using 1% CPU to serve HTTP500 errors to the 80% of the customer base, sort of thing.
Angad Sethi:
How do you do that? The SLO's bit, how do you know a user can log in and drag an issue?
Jordan Simonovski:
Yeah. I think that would come with good instrumenting-
Angad Sethi:
Good question?
Jordan Simonovski:
Yeah, it comes down to actually keeping observability in mind when you are developing new features, the same way you would think about logging a particular thing in your code as you're writing, or writing test for your code, as you're writing code as well. You want to think about how you can instrument something and how you can understand how this particular feature is working in production. Because I think as a lot of Agile and dev ops principles are telling us now is that we do want our applications in production. And as developers, our responsibilities don't end when we deploy something. Our responsibility as a developer ends when we've provided value to the business. And you need a way of understanding that you're actually doing that. And that's where, I guess, you do nee do think about observability with a lot of this stuff, and actually measuring your success metrics. So if you do know that your application is successful if your user can log in and drag stuff around, then that's exactly what you want to measure.
Jared Kells:
I think that we have to build-
Jordan Simonovski:
Yeah?
Jared Kells:
Oh, sorry Jordan.
Jordan Simonovski:
No, you go.
Jared Kells:
I was just going to say we have to build our apps with integration testing in mind already. So doing browser based tests around new features. So it would be about building features with that and the same thing in mind but for testing and production.
Jess Belliveau:
Yeah and the actual how, the actual writing code part, there's this really great project, the open telemetry project, which provides all these sort of API's and SDK's that developers can consume, and it's vendor agnostic. So when you talk about the how, like, "How do I do this? How do I instrument things?" Or, "How do I emit metrics?" They provide all these helpful libraries and includes that you can have, because the last thing you want to do is have to roll this custom solution, because you're then just adding to your technical debt. You're trying to make things easier, but you're then relying on, "Well I need to keep Jared Kells employed, because he wrote our log in engine and no one else knows how it works.
Jess Belliveau:
And then the other thing that comes to mind with something like open telemetry as well, and we talked a bit about Datadog. So Datadog is a SaaS vendor that specializes in observability. And you would push your metrics and your logs and your traces to them and they give you a UI to display. If you choose something that's vendor agnostic, let's just use the example of Easy Agile. Let's say they start Datadog and then in six months time, we don't want to use Datadog anymore, we want to use SignalFx or whatever the Splunk one is now.
Jordan Simonovski:
I think NorthX.
Jess Belliveau:
Yeah. You can change your end point, push your same metrics and all that sort of stuff, maybe with a few little tweaks, but the idea is you don't want to tie in to a single thing.
Jordan Simonovski:
Your data structures remain the same.
Jess Belliveau:
Yeah. So that you could almost do it seamlessly without the developers knowing. There's even companies in the past that I think have pushed to multiple vendors. So you could be consuming vendor A and then you want to do a proof of concept with vendor B to see what the experience is like and you just push your data there as well.
Jared Kells:
Yeah. I think our coupling to Datadog will be I all the dashboards and stuff that we've made. It's not so much the data.
Jess Belliveau:
Yeah. That's sort of the big up sell, right. It's how you interact. That's where they want to get their hooks in, is making it easier for you to interpret that data and manipulate it to meet your needs and that sort of stuff.
Jordan Simonovski:
Observability suggests dashboards, right?
Jess Belliveau:
Yeah, perhaps. You used this term as well, Jordan, "production excellence." And when we talk about who needs observability, I was thinking a bit about that while you were talking. And for me, production excellence, or in Apptio we call it production readiness, operational readiness and that sort of stuff is like we want to deploy something to production like what sort of best practices do we want to have in place before we do that? And I think observability is a real great idea, because it's helping you in the future. You don't know what problems you're going to have down the line, but you're equipping your teams to be able to respond to those problems easily. Whereas, we've all probably been there, we've deployed code of production and we have no observability, we have a huge outage. What went wrong? Well, no one knows, but we know this is the fix, and it's hard to learn from that, or you have to learn from that I guess, and protect the user against future stuff, yeah.
Jess Belliveau:
When I think easy wins for observability, the first thing that really comes to mind is this whole idea of structured logging, which is really this idea that your application is you're logging, first of all. Quite important as a baseline starting point, but then you have a structured log format which lets you programmatically pass the logs as well. If you go back in time, maybe logging just looked like plain text with a line, with a timestamp, an error message. Whatever the developer decided to write to the standard out, or to the error file or something like that. Now I think there's a general move to having JSON, an actual formatted blob with that known structure so you can look into it. Tracing's probably not an easy win. That's a little bit harder. You can implement it with open telemetry and libraries and stuff. Requires a bit more understanding of your code base, I guess, and where you want tracing to fire, and that sort of stuff, parsing context through, things like that.
Jordan Simonovski:
I think Atlassian, when you probably just want to know that everything is okay. At a fairly superficial level. Maybe you just want to do some kind of up time on a trend. And then as, I guess, your code might get more complex or your product gets a bit more complex, you can start adding things in there. But I think actually knowing or surfacing the things you know might break. Those would probably be your quickest wins.
Jess Belliveau:
Well, let's mention some things for further reading. If you want to go get the whole picture of the whole, real observability started to get a lot of movement out of the Google SRE book from a few years ago. The Google SRE stuff covers the whole gamut of their soak reliability engineering practice, and observability is a portion of that, there's some great chapters on that. O'Reilly has an observability book, I think, just dedicated to observability now.
Jordan Simonovski:
I think that's still in early release, if people want to google chapters.
Jess Belliveau:
The open telemetry stuff, we'll drop a link to that I think that's really handy to know.
Angad Sethi:
From [inaudible 00:26:12], which is my perspective, as a developer, say I wanted to introduce cornflake use Datadog at Easy Agile. Not very familiar, I'm not very comfortable with it. I know how to navigate, but what's a quick way for me to get started on introducing observability? Sorry to lock my direct job or at my workplace.
Jordan Simonovski:
I would lean, I could be biased here. Jess correct me or give your opinion on this, I would lean heavily towards SLO's for this. And you can have a quick read in the SRE-
Jess Belliveau:
What does SLO stand for, Jordan?
Jordan Simonovski:
Okay, sorry. Buzz words! SLO is a service level objective, not to be confused with service level agreement. An agreement itself is contractual and you can pay people money if you do breach those. An SLO is something you set in your team and you have a target of reliability, because we are getting to the point where we understand that all systems at any point in time are in some kind of degraded state. And yeah, reliability isn't necessarily binary, it's not unreliable or reliable. Most of the time, it's mostly reliable and this gives us a better shared language, I guess. And you can have a read in the SRE handbook by Google, which is free online, which gives you a pretty good understanding of Datadog.
Jordan Simonovski:
I think the last time I used it had a SLO offering. But I think like I was mentioning earlier, you set an SLO on particular functionalities or features of your application. You're saying, "My user can do this 99% of the time," or whatever other reliability target you might want to set. I wouldn't recommend five nines of reliability. You'll probably burn yourself out trying to get there. And you have this target set for yourself. And you know exactly what you're measuring, you're measuring particular types of functionality. And you know when you do breach these, users are being affected. And that's where you can actually start thinking about observability. You can think about, "What other features are we implementing that we can start to measure?" Or, "What user facing things are we implementing that we can start to measure?"
Jordan Simonovski:
Other things you could probably look at are, I think they're all covered in the book anyway, data freshness in a way. You want to make sure the data users are being displayed is relatively fresh. You don't want them looking at stale data, so you can look at measuring things like that as well. But you can pretty much break it down into most functionalities of a website. It's no longer like a ping check, that you're just saying, "Yes, HTTP, okay. My application is fine." You're saying, "My users are actually being affected by things not working." And you can start measuring things from there. And that should give you a better understanding, or a better idea, at least, of where to start with what you want to measure and ow you want to measure it. That would be my opinion on where to get started with this if you do want to introduce it.
Jared Kells:
We're going to talk a little bit about state and how with some of these, like our very front end heavy applications that we're building, so the applications we build just basically run inside the browser and the traditional state as you would think about it, is just pulling a very simple API that writes some things into the database with some authentication, and that sort of stuff. So in terms of reliability of the services, it's really reliable. Those tiny API's just never have problems, because it's just so simple. And well, they've got plenty of monitoring around it. But all our state is actually, when you say, "Observe the state of the system," for the most part, that's state in a browser. And how do we get observability into that?
Jess Belliveau:
A big thing is really, there's not one thing fits all as well. When we talk about the SLO stuff as well, it's understanding what is important to not so much maybe your company but your team as well. If you're delivering this product, what's important to you specifically? So one SLO that might work for me at Apptio probably isn't going to work for Easy Agile. This is really pushing my knowledge, as well, of front end stuff, but when we say we want to observe the state as well, we don't necessarily mean specifically just the state. You could want to understand with each one of those API's when it's firing, what the request response time is for that API firing. So that might be an important metric. So you can start to see if one of those APIs is introducing latency, and so your user experience is degraded. Like, "Hey when we were on release three, when users were interacting with our service here, it would respond in this percentile latency. We've done a release and since then, now we're seeing it's now in this percentile. Have we degraded performance performance?" Users might not be complaining, but that could be something that the team then can look into, add to a sprint. Hey, I'm using Agile terms now. Watch out!
Jared Kells:
That's a really good example, Jess. Performance issues for us are typically not an API that's performing poorly. It's something in this very complicated front end application is not running in the same order as it used to, or there's some complex interaction we didn't think of, so it's requesting more data than expected. The APIs are returning. They're never slow, for the most part, but we have performance regressions that we may not know about without seeing them or investigating them. The observability is really at the individual user's browser level. That makes sense? I want to know how long did it take for this particular interaction to happen.
Jess Belliveau:
Yeah. I've never done that sort of side of things. As well, the other thing I guess, you could potentially be impacted in as well as then, you're dealing with end user manifestations as well. You could perceive-
Jared Kells:
Yeah sure.
Jess Belliveau:
... Greater performance on their laptop or something, or their ISP or that sort of stuff. It'd be really hard to make sure you're not getting noise from that sort of thing as well.
Jordan Simonovski:
Yeah. There are tools like Sentry, I guess, which do exist to give you a bit more of an understanding what's happening on your front end. The way Sentry tends to work with JavaScript, is you'll upload a minified map of your JS to Sentry, deploy your code and then if something does break or work in a fairly unexpected way, that tends to get surfaced with Sentry will tell you exactly which line this kind of stuff is happening on, and it's a really cool tool for that company stuff. I don't know if it'd give you the right type of insights, I think, in terms of performance or-
Jared Kells:
Yeah, we use a similar tool and it does work for crashes and that sort of thing. And on the observability front, we log actions like state mutations in side the front end, not the actual state change, but just labels that represent that you updated an issue summary or you clicked this button, that sort of thing, and we send those with our crash reports. And it's super helpful having that sort of observability. So I think I know what you guys are talking about. But I'm just [crosstalk 00:35:25], yeah.
Jess Belliveau:
Yeah, that's almost like, I guess, a form of tracing. For me and Jordan, when we talk about tracing, we might be thinking about 12 different microservices sitting in AWS that are all interacting, whereas you're more shifting that. That's sort of all stuff in the browser interacting and just having that history of this is what the user did and how they've ended up-
Jared Kells:
In that state.
Jess Belliveau:
In that state, yeah.
Jordan Simonovski:
I guess even if you don't have a lot of microservices, if you're talking about particular, like you're saying for the most part your API requests are fine but sometimes you have particularly large payloads-
Jared Kells:
We actually have to monitor, I don't know, maybe you can help with this, we actually should be monitoring maybe who we're integrating with. It's actually much more likely that we'll have a performance issue on a Xero API rather than... We don't see it, the browser sees it as well, which is-
Jordan Simonovski:
Yeah, and tracing does solve all of those regressions for you. Most tracing libraries, like if you're running Node apps or whatever on your backend. I can just tell you about Node, because I probably have the most experience writing Node stuff. You pretty much just drop in Didi trace, which is a Datadog library for tracing into your backend and your hook itself into all of, I think, the common libraries that you'll tend to work with, I think. Like if you're working for express or for a lot of just HADP libraries, as well as a few AWS services, it will kind of hook itself into that. And you can actually pinpoint. It will kind of show you on this pretty cool service map exactly which services you're interacting with and where you might be experiencing a regression. And I think traces do serve to surface that information, which is cool. So that could be something worth investigating.
Jess Belliveau:
It's funny. This is a little bit unrelated to observability, but you've just made me think a bit more about how you're saying you're reliant on third party providers as well. And something I think that's really important that sometimes gets missed is so many of us today are relying on third party providers, like AWS is a huge thing. A lot of people writing apps that require AWS services. And I think a lot of the time, people just assume AWS or Jira or whatever, is 100% up time, always available. And they don't write their code in such a way that deals with failures. And I think it's super important. So many times now I've seen people using the AWS API and they don't implement exponential back off. And so they're basically trying to hit the AWS API, it fails or they might get throttled, for example, and then they just go into a fail state and throw an error to the user. But you could potentially improve that user experience, have a retry mechanism automatically built in and that sort of stuff. It doesn't really tie into the observability thing, but it's something.
Jared Kells:
And the users don't care, right? No one cares if it's an AWS problem. It's your problem, right, your app is too slow.
Jess Belliveau:
Well, they're using your app. Exactly right. It reflects on you sort of thing, so it's in your interest to guard against an upstream failure, or at least inform the user when it's that case. Yeah.
Jared Kells:
Well, I think we're going to have to call it, this podcast, because it was an hour ago. We had instructed max 45 minutes.
Jess Belliveau:
We could just keep going. We might need a part two! Maybe we can request [cross talk 00:39:21].
Jared Kells:
Maybe! Yeah.
Jess Belliveau:
Or we'll just start our own podcast! Yeah.
Angad Sethi:
So what were your biggest learnings today, given it's been Angad and I are just learning about observability, Angad what was your biggest learning today about observability? My biggest learning was that observability does not equal Datadog. No, sorry! It was just very fascinating to learn about quantifying the known unknowns. I don't know if that's a good takeaway, but...
Jess Belliveau:
Any takeaway is a good takeaway! What about you, Jared?
Jared Kells:
I think, because I we were going to talk about state management, and part of it was how we have this ability, at the moment to, the way our front ends are architected, we can capture the state of the app and get a customer to send us their state, basically. And we can load it into our app and just see exactly how it was, just the way our state's designed. But what might be even cooler is to build maybe some observability into that front end for support. I'm thinking instead of just having, we have this button to send us out your support information that sends us a bunch of the state, but instead of console logging to the browser log, we could be console logging, logging in our front end somewhere that when they click, "send support information," our customers should be sending us the actions that they performed.
Jared Kells:
Like, "Hey there's a bug, send us your support information." It doesn't have to be a third party service collecting this observability stuff. We could just build into our... So that's what I'm thinking about.
Jess Belliveau:
Yeah, for sure. It'll probably be a lot less intrusive, as well, as some of the third party stuff that I've seen around.
Jared Kells:
Yeah. It's pretty hard with some of these integrations, especially if you're developing apps that get run behind a firewall.
Jess Belliveau:
Yeah
Jared Kells:
You can't just talk to some of these third parties. So yeah, it's cool though. It's really interesting.
Jess Belliveau:
Well, I hope someone out there listening has learned something, and Jordan and I will send some links through, and we can add them, hopefully, to the show notes or something so people can do some more reading and...
Jared Kells:
All thanks!
Jess Belliveau:
Thanks for having us, yeah.
Jared Kells:
Thanks all for your time, and thanks everybody for listening.
Jordan Simonovski:
Thanks everyone.
Angad Sethi:
That was [inaudible 00:41:55].
Jess Belliveau:
Tune in next week!
- Podcast
Easy Agile Podcast Ep.22 The Scaled Agile Framework
"Rebecca is an absolute gold mine of knowledge when it comes to SAFe, can't wait to continue the conversation at SAFe Summit 2022!"" - Tenille Hoppo
In this episode, Rebecca and Jasmin are talking:
📌 The value of the Scaled Agile Framework, who it’s for & who would benefit
📌 The Importance of having a common language for organizations to scale effectively
📌 When to connect the Scaled Agile Framework with your agile transformation
📌 Is there ever really an end state?
+ more!
📲 Subscribe/Listen on your favourite podcasting app.
Thanks, Jasmin and Rebecca!
Transcript
Jasmin Iordandis:
Hello, and welcome to the Easy Agile podcast, where today we're chatting all things Scaled Agile with Rebecca Davis, SAFe Fellow, SPCT, principle consultant and member of the SAFe framework team. Rebecca is passionate about teamwork, integrity, communication, and dedication to quality. And she's coached organizations on building competitive market-changing products at scale while also bringing joy to the work, for what is work without joy. Today, we've chatted all things Scaled Agile implementations, challenges, opportunities, and also the idea around optimizing flow, which Rebecca is hosting a workshop at the SAFe Summit in Denver in August this year. Hope you enjoy the podcast.
Jasmin Iordandis:
Hello everyone, and welcome to the Easy Agile podcast. I'm your host Jasmin Lordandis, product marketing manager here at Easy Agile. And today, we are delighted to welcome Rebecca Davis from the Scaled Agile framework. Welcome, Rebecca, and thanks for joining us.
Rebecca Davis:
Thanks. I appreciate being here. I'm excited.
Jasmin Iordandis:
Me too, especially because we are counting down the days before we get to meet you face to face, in person, at the SAFe Summit over in Denver, Colorado. And before we kick off our conversation, I just want to acknowledge the traditional custodians of the land from which we broadcast our podcast today. The people of the Djadjawurrung speaking country. We pay our respects to elders past, present and emerging, and extend that same respect to all Aboriginal Torres Strait Islanders and First Nations' people joining us today. So before we kick off, Rebecca, can you tell us a little bit about yourself and your role within Scaled Agile?
Rebecca Davis:
Sure. I'm actually relatively new to working for Scaled Agile. So I've been there a little over 90 days now, and I'm a member of the framework team, which means I help actually create the Scaled Agile framework and future versions of it. Prior to that, I led LACE at a company called CVS Health, and I've worked at a bunch of different kind of healthcare organizations across my years implementing or organizing agile transformation and digital transformation. And I think one of the reasons that Scaled Agile was interested in me joining the team is just a lot of different experiences across business agility as a whole outside of technology, in addition to within technology. So marketing transformations and HR transformations, legal transformations. But I love being at Scaled Agile and being part of the framework team. It's really exciting to help more organizations, and just the one I'm at, really understand how to bring joy to their workplace and bring value out to the world.
Jasmin Iordandis:
Yeah, cool. And you've given a little bit of information there around why Scaled Agile was interested in you. What attracted you to Scaled Agile, and did you use the Scaled Agile framework in these previous roles that you've just described?
Rebecca Davis:
Yeah. Those are great questions. I think I'm going to try to answer both of them together. But the reason I have always been drawn to the Scaled Agile framework is I ran a few different organizations, both as owning my own company and then also working in startups and working with larger organizations, where I knew that agility was important. But I was struggling as a change leader to find a way to really bring connectedness across large amounts of people. And to me, that's what Scaled Agile does for us, is after a certain size, it's a lot easier to create this common language and this common way to move forward and produce value with the framework. I also really enjoy it because there's a lot of thought that's already kind of done for you.Rebecca Davis:
So if you're in an organization and you're trying to create change or change leadership, I'd much rather be leading the conversations and my context and making sure that I have a pulse on my particular cultural environment and pull from all these pieces, from the framework, where the thought's already been done about what are the right words and what do we do next, and what's the next step. So I've just found it an invaluable toolkit as a change leader.
Rebecca Davis:
I joined the framework team for a few reasons. One, I'd led so much change in so many different areas that, it's not that I wasn't challenged anymore, but I was really looking for something larger and different, and I've always had a belief that I really want to be the change that I want to see in the world. And I think being part of the framework team gives me access to things like this and all over the world to really help connect the humanness of people alongside with all the great techniques that we've learned, and hopefully expand it and just create a better place to be in.
Jasmin Iordandis:
Yeah. Cool. And you kind of touched on that in your response, but if we had to say, who is the Scaled Agile framework for and who would it most benefit, what would you say to that?
Rebecca Davis:
Yeah. I guess my opinion on that is I believe the Scaled Agile framework is for people who believe that their organizations have it in them to be better, both internally inside of themselves, as well as have this gigantic potential to go help the customers they serve and may be struggling right now, to really realize that potential. So I don't really see the framework as it's for a specific role necessarily. I think it's for people who believe in betterness. And those people, I found, live across an organization and across multiple different roles, and the framework just really helps you align that.
Jasmin Iordandis:
Yeah. And I think one thing that's evident from SAFe, once you learn how all the different practices and ceremonies work together, is exactly as you've said around connectiveness. And you also touched on having a common language. How important is that, when we're talking really large organizations with multiple different functions who, let's be honest, it's quite common for different functions to fall into different silos and things to break down. So how important is that connectivity and that common language, so that an organization as a whole can scale together?
Rebecca Davis:Yeah. I don't even know how to state the amount of importance that is. I guess, specifically the organization I just came from, had over 400,000 people that worked there. And the last thing I want to is to debate what the word feature means, because that doesn't actually end up within a conversation where we have an understanding of why we want to feature or why we want this particular outcome, or how this outcome relates to this other outcome, if we're spending so much time just choosing word choice and having a conversation instead about what does the word even mean.
Rebecca Davis:
So I like it mostly because it gives us all this common framework to debate, and we need to be able to do that in really transparent and open ways across all of our different layers. So I don't even know how to quantify how much value it brings just to have this ability to bring stability, and the same language across the board, same word choice, same meaning behind those word choice, so that we can have all those debates that we need to have about what's the best possible thing we could be doing, since everything that we can do is valuable, but some things we have to decide are more valuable than others.
Jasmin Iordandis:
Yeah. And I think that really talks to what you were saying about helping an organization to reach its potential. It sounds like getting bogged down in what you call things or how you discuss things. And to be able to align on a common meaning in the end, you kind of need that common structure or that common language. And you're only going to get in your own way if you don't have it. So it makes total sense that the framework could really enable organizations on that journey. And in your experience, because it's implied in the name, it's about scaling agile. And I guess when we think of the Scaled Agile framework, we think of all those organizations of such a large size as the one you just mentioned, 400,000 employees. In your experience, what's a good time to introduce the Scaled Agile framework? Does it need to be right from the beginning? Does it need to be those organizations that are 400,000 people strong? Where is the right time to intersect the framework with an agile transformation?
Rebecca Davis:
Yeah. I think that's a really fascinating question, and my answer has changed over the years. I originally started researching Scaled Agile, because it was my first big transformation alongside of a large organization, and I knew there had to be some solutions out there to the problems I was seeing, and I discovered SAFe. But thinking back, I started my own startup company right out of high school actually. And I really wish that I would've had something to pull from, that gave me information about lean business cases, and speaking with my customer and getting tests and getting feedback. So I feel like the principles and the practices and the values are something that could be used at any size.
Rebecca Davis:
I think the part about scaling, the part about deciding like, "Hey, I'm going to do PI planning," I don't personally feel like you need to do PI planning if you have four people at your organization, because the point is to get teams across different groups to talk. You should definitely plan things 100%. So I think part of the idea is like, "When do I implement a train," or, "When do I have a solution train," or, "When do I officially call something LPM," versus just having discussions because my company is so small that we can all have discussions about things. I think those are a different part of implementing the Scaled Agile framework than just living and believing in the principles and the values and the mindset from whatever size or get-go you're at. Does that make sense at all?
Jasmin Iordandis:
That does make sense. And I guess then the question becomes, where do you begin and what would the first step be in implementing SAFe? And taking from your own experience, where do you start with this framework?
Rebecca Davis:
Yeah. I love that you asked that, as I've honestly seen this happen to me as well as some other change agents, where Scaled Agile gives us this thing called the implementation roadmap, and it has all the steps that you can start with. And it's proven, and companies use it and it works. And what I've found in my own change leadership is when I skip a step or I don't follow that because I get pressure to launch a train, instead of starting with getting my leaders at the right tipping point or having that executive buy in, it causes me so much pain downstream.
Rebecca Davis:
So if I were to give advice to somebody, it's, "Look, pull that map down the implementation roadmap from the SAFe site and follow it. And keep following it. And if you find that you..." I think that, back when I look back and do my own retrospective, the moments where I've decided to launch a train without training my people or launch or start doing more product management practices without actually training my people, it causes me a world to hurt later on with coaching and with communication, with feedback. So it's there for that reason. Just follow it. It's proven.
Jasmin Iordandis:
Yeah. And that's really good advice. And I think when people look at the roadmap for SAFe, there's a lot on there. But when we are talking agile transformations, necessarily there is going to be a lot that could get you there. So it kind of makes sense when all the thinking is been done for you and all those steps have been done. Just trust the process, I guess, is the message there, and following through on all of that. And I think it's really interesting, because the first step with SAFe is, as you say, getting your leaders on board. And often, we might be attracted to doing the work better. So let's start with those ceremonies. Let's start with all those things that make the day to day work better. How important it starting with the leaders of an organization?
Rebecca Davis:
Yeah. I've run the grassroots SAFe implementations where you start with the bottom and then you kind of move up. And personally, and this is a personal opinion, I'd much rather take the time and the efforts to get the communication right with the leaders and get the full leadership buy-in than be in that place again, where I'm trying to grassroot to move up and I hit the ceiling. The one thing I used to kind of tell the coaches that reported to me, and something I believe in deeply, is what we're trying to do with transformation is a journey. It's not a destination. So because we want to start that journey healthy and with a full pack of food and all those things, we need to take the time to really go and be bold and have conversations with our leaders, get their buy-in to go to Leading SAFe.
Rebecca Davis:If they're not bought in to coming to a two-day course, then why would we believe that they're going to come to PI plannings and speak the way that we hope they will and create the change that they need to really lead? So I think that's one of the most important things, if not the most important thing from the very beginning, is be bold as that first change leader in your organization, go make those connections.
Rebecca Davis:
It may take a while. I've been in implementations or transformations where it started with just me discovering issues that senior leaders or executives were having, and going and solving some of those, so that there was trust built that I was a problem solver. So I could ask for the one hour executive workshop, which really should be a four to six-hour executive workshop, to get to the point where I could do the four to six-hour executive workshop, to get to the point where I could do PI Leading SAFe. And if that's what it takes to gain you that street cred to go do it, then, man, go do it, because that's where you get full business agility, I think, is getting that really senior buy-in and getting that excitement.
Jasmin Iordandis:
Yeah. That's really interesting. And I think building that level of understanding and building that foundation, we can't go past that. And I guess on that as well, from your experience, you've kind of hinted at one there, but what have been some of the challenges that you've experienced in implementing SAFe or even just in agile transformations more broadly, and as well as some of those opportunities that the framework has helped to unlock? So let's start with the challenges. What's some of the hard things you've experienced about an agile transformation and even implementing the framework?
Rebecca Davis:
Yeah, I'll give some real examples, and this first thing is going to sound a little wishy washy, but I also believe it, is the biggest challenge to transformation is you. So what I've discovered over the years, is I needed to step up. I needed to change. I think it's really easy to be in an organization and say, "My leaders don't get it," or, "Some won't understand," or, "It's been this way and I can't change it." And I think that the first thing you have to decide is that that's not actually acceptable to you as a person. And so you as a person are going to go fight. Not you're going to go try to convince somebody else to fight, but you are going to go fight. So I think that personal accountability is probably the biggest challenge to wake up every single day and say, "I'm going to get back in there."
Rebecca Davis:
I think from an example point of view, I've definitely seen huge challenges when the executive team shifts. So when we've got a set of leaders that we did the tipping point, we've gone through Leading SAFe, we've launched our trains. And then the organization, because every organization is going through a lot of change right now, and people are finding new roles and retiring and all that, there's a whole new set of executive leaders. And I think one of the things to discover there is there are going to be moments where it sucks, but you have to go and restart that implementation roadmap again, and reach that tipping point again, because there are new leaders. And that's hard. It really is, and it drains you a little bit, but you've just got to do it.
Rebecca Davis:
I think other challenges I've run into is there's a point after you've launched the trains and after you have been running for a while, where if you don't pay attention, people will stop learning, because you're not actively saying like, "Here's the next thing to learn. Here's the next new thing to try." So I do think it's the responsibility of a change leader, no matter if you're a LACE leader or not, to pay attention to maintaining excitement, pay attention to the continuous learning culture and really motivate people to get excited about learning and trialing and trying.Jasmin Iordandis:
Yeah. That's an interesting point. How have you done that?
Rebecca Davis:
Hmm. So I think a few things. One, I had big lessons learned that there's a point inside of a transformation where, as an SPBC or as a change leader, that transformation is not yours anymore. So I had kind of a painful realization at one point that I had in my head the best next thing for the organization, and I was losing pulse of the people who are actually doing the work. So I think what I've discovered after that is, to me, there's a point where your LACE members and your change leaders and your SPCs need to start coming from a lot more areas. And honestly start to be made up of people who are not, at the moment, excited about the SAFe implementation, so you can hear from the pulse of the people.
Rebecca Davis:
And then I think if you can get those people and invite in and say like, "I'm inviting you to share it with me what's frustrating, what's good, what's bad, what's great, as well as I'm inviting you to tell me all the things that you're discovering out there in webcasts or videos that seem you'd like to try them, but we're not trying yet, and start giving back the ability to try new things and try things that you feel are probably going to be anti-patterns, but they need to try them anyway." So kind of a scrum master would do with a team of like, "Yeah, go try and then we'll retrospect." I think you have to do that at scale and let people get excited about owning their own transformation.
Jasmin Iordandis:
And what's the balance there between implementing the framework and taking all the good stuff that the framework says is good to do, and then letting people experiment and try those things, as you say, that may be anti-patents? Where's that sweet spot to allow that autonomy and that flexibility and that experimentation with still maintaining the integrity of the framework?
Rebecca Davis:
So I think the interesting thing is they are not actually different. So in the framework, we say hypothesis first, test first. So what I found is a layered kind of brain path where there're the steps in the framework and make sure we have teams and balance trains and all the principles and the values, and if you can live those principles and values all the time, while you're testing new things. So you test first like, "Hey, I want to try having my train off cadence from the other trains. I think it would be helpful for us." "Cool. Test that." And what we have to test it against is are we still living our principles? Are we still applying our values? Are we still applying the core fundamentals of agility and lean throughout that test and also as proof points?
Rebecca Davis:So do we have an outcome where," Hey, I just made my train into a silo," or do we have an outcome where, "Well, now we have two different PI plannings within the overall PI cadence that one of them we merge with all the other trains and the other one is shorter because our market cadence is faster." Well, that's a beautiful win. So I think the key is it's not different, but one of the test points is make sure to check in on those principles and values.
Jasmin Iordandis:
Yeah. Have you ever seen that work well? The example that you just provided with the PI cadence, that makes complete sense, and it doesn't seem like it's going against the grain with anything that SAFe is there to help you achieve.
Rebecca Davis:
Yeah, I think that. This was kind of a little bit of what my summit talk was on last year, is during COVID, there were some trains. We had, I don't know, 30 trains. Two of them were having daily new requirements emerging from all the different states across the United States and emerging from the government and emerging from everything. Those trains were making sure everybody could get vaccinated across the United States. That's really darn important. And they needed to re-plan sometimes daily. It just didn't make sense to say, "Now we're just going to stop and go into PI planning for three days," when there wasn't any way that they could even think about what the next day's requirements could be. Since then, they still have a faster market rhythm. Then there are other trains that are working on, have a set unknown. There are trains that know that these holidays are when we need to release something or end of year is when we need to make sure that we've got something ready.
Rebecca Davis:
COVID is still in a reactive state. So what they've emerged into this year is those trains are still doing PI planning from my knowledge, I'm not there anymore, but from my knowledge. But they do eight a year instead of four a year. And four a year are on the same cadence and the other four are not, and it meets both needs. So I do think that key is test, and don't test just for the sake of it just because something feels dry or you get a new leader, and they haven't gone through Leading SAFe, but test because something actually doesn't feel right about, "We're not meeting our principles or values right now. We think that we could meet them better in this way. We think we could accelerate the flow of value in this way. Let's try it."
Jasmin Iordandis:
Yeah, cool. And on that, what are some of the red flags that you've seen in practice where those values aren't being met to be able to say, "Hang on a sec. This isn't working. We need to switch course"?
Rebecca Davis:
Yeah. Some of the things I've seen are the whole fun around when people are prioritizing their hierarchy or their piece of the organization over the enterprise value. So I've definitely seen people come to me and say, "Hey, I'd like to do his test." And when I ask the reasons why, a lot of the reasons are like a thinly veiled, "Because I would like more control."
Rebecca Davis:So I think back to the values piece is that, "Okay, what's your why? Let's start with why. Why would you like to try something? What does that trial outcome achieve?" And, A, if it's really hard to articulate, probably there might be a bad thing going on, or if it is articulated and it actually goes against agility or lean practice and or diminishes flow or creates a silo, that's an initial gut. I think throughout testing, it's important to, the same way that we would do with iterations, have check-ins and demos, not just of what's the product being produced, but what is the change producing? So figuring out what those leading indicators would be and treat it the same way as we would treat a feature hypothesis or an epic hypothesis. We have some outcome we believe we could achieve. We're 100% open to being proven wrong. These are the things that we want to see as leading indicators as success and be really open with each other.
Jasmin Iordandis:
Yeah, cool. And it sounds like what's key to that though is having some concept of what that intended outcome is as a result of that experiment. It's not just going in for, as you say, the sake of doing an experiment. You want to have an idea of where you want to end up, so you can see if we're actually getting there or not.
Rebecca Davis:
Yeah.
Jasmin Iordandis:
That's really fascinating. And I think experimentation and iterative improvement, it kind of goes together. It's not just blindly following something because that's what you are supposed to do. It's preserving the values. That's a really interesting concept. And I think in that, would also come enormous opportunity. So in your experience as well, going back to the times where you've brought SAFe to an organization, or you've been going through an agile transformation, what are some of those opportunities that you've seen the framework unlock for enterprises or organizations that you've been leading those transformations within?
Rebecca Davis:
Yeah. I always was drawn to this idea of true value flow and business agility. So for me, what Scaled Agile helped unlock in a few of my organizations is, I always targeted that, like I'm not trying to make my thing better, I'm trying to make everything better. And with that mindset, really pushing for anybody should be able to take a class. Anybody should be able to take any of the classes. And these days, the enterprise subscription helps with that a lot. When I first started, we didn't have that. So it was also like anybody can take a class, and there should be creative ways of getting it paid for it.
Rebecca Davis:
But through that kind of invite model of really anybody, I had a nurse come take one of my SAFer teams classes, just because she was curious and she saw something about it on my blog, which ended up with her being more excited and getting to do agile team coaching for a set of nurses who were highly frustrated because their work on an individual basis was ebbing and flowing so much, and they felt like they weren't giving good patient care to coaching them on Kanban and having them all get really excited because they got to nurse as a team and whoever was available took the next patient case, and the patients were happier, and just being able to invite in and then say yes to coaching all of these roles that are so meaningful and they're so excited and they're something different.
Rebecca Davis:
And that same model ended up going from nothing to having a marketing person randomly take one of my Leading SAFe classes, which then turned into them talking to the VPs of marketing, which then turned into an 800-person marketing implementation. So I think the key is be open and spend time with the curious. And it doesn't matter if they're in your org. It's not like that's what I was paid to do, it's just really fun. So why not? If somebody wants to talk to you about agile, talk to them about agile. It's really cool.
Jasmin Iordandis:
Yeah, cool. And I think what I love about that is often agile may be associated just as software development teams. But as someone who's in marketing myself, I love the benefit and the way of thinking that it can provide to very traditional challenges, but the way that it can unlock those challenges in ways that not have not been approached before. And I think that there's something to be said in that too, around what you were saying earlier around maintaining excitement. And I feel like this question's already been answered, because often it's discussed, "Okay, we are scaling agile, we're going through a transformation." And it implies that there's this end state where it's done. It's transformed or we've scaled agile, but it doesn't sound like that's the case at all.
Rebecca Davis:
No, I don't think at all. I think mostly the opposite of... If you look at even yourself as a human, your whole life, you're transforming in different ways. Everything's impacting you. The environment's impacting you, whatever happens in your life is just this whole backpack that you carry around and you're transforming all the time. And the exact same thing, I think, for an organization and company. Today's age is nuts. There're updates all the time, there's new technology all the time. You and I are doing a talk from completely different countries, and there's change literally everywhere.
Rebecca Davis:
So yeah, I think part of transformation is helping your organization feel comfortable or as comfortable as possible with the rate of change happening and all the people within it, and not see change as a bad word, but as a positive thing where we can make betterness out there. And it's forever. It's a journey. It's not done. I really like Simon Sinek when he talks about that infinite game. I just feel really close to that of, we're not in it to win this moment or this year, we're in it to make a better future for ourselves and our children, and that's going to take forever. The people are in it right now and they've got to be excited about that.
Jasmin Iordandis:
Yeah. And I think that's that balance of delayed gratification, but constant improvement. So you'll feel and experience the improvement along the way. It's not like it'll be way out in the future where you won't feel the benefit of what you're doing, but it's something that's going to be built up and happen over time.
Rebecca Davis:Yeah. And I think you reminded me just from saying that. I did that marketing transformation, and I just deeply remember a call with one of the marketing VPs who, after four or five iterations, I did a check in with her. And she's like, "My team is so happy. Is this because of agile? Is this what agile is, is happy with [inaudible 00:32:17]?" "Yes."
Jasmin Iordandis:
Yeah, joy at work, right?
Rebecca Davis:
Yeah.
Jasmin Iordandis:
Isn't that what it's all about? That is so cool. And yet the goal initially is never to go out and make people happy. It's just one of those bonus kind of side effects, a happy side effect.
Rebecca Davis:
Yeah.
Jasmin Iordandis:
Awesome. And I think I really want to talk about this idea, because you've mentioned it a couple times, you've even just mentioned then marketing, nursing. But then when you're in these larger organizations, you've got all these different functions. And I think it raises this idea around organizing around value. So I want to make sure we talk a bit about that, because value doesn't just happen from one function, or it's not delivered from just one function or one team. It's something that many people across an organization may have a hand in delivering. But I really want to get your take around this concept of organizing around value. What does that mean and what does that look like?
Rebecca Davis:
Yeah. I think there's a base concept that is also in that implementation roadmap around what happens first. So how do we first organize around value, because organizations tend to be organized around hierarchy. I am a VP of marketing and I have marketing all the way down. And so there's that first step of identifying what the value is that you produce as an organization. So being able to articulate it to begin with, which is not always an easy conversation. Sometimes it takes a bit of time, and then organizing all the different types of roles around what that value is. So I think that's your first thing in what most organizations implementing scaled agile start with, is just identifying it, forming around it, which ends up being what your trains end up being.
Rebecca Davis:
My experience is, because of that same rapid market change, the world changing so far, it's really important to re-evaluate how you've organized around value over time. So in my experience, one of the really healthy things that we used to do is, at the end of each year, give a chance to look at the different train structures and look at how we've organized and say, "Is this still right? And what's our strategy for next year? Where are we trying to head for our consumers and our users? And is there a different way to organize, that helps us with that?" And I say give a chance because in some years, we'd be like, "No. 80% of our portfolio is actually good to go. Things are flowing. We're doing okay." 20% of it has an entirely new strategic shift that's going to hit them, or, "Last year felt not good. We had too many dependencies. We didn't have the right people on the right trains," all those things.
Rebecca Davis:
And so at least take a pause and look at it, and see if our value still mean the same thing as it did a year ago or two years ago. Do we need to reorganize? What does that mean? What does the change leadership around it if we do need to, so that we're always focused on value, and it's not a definition that we gave ourselves five years ago and just stopped realizing that the world has changed.
Jasmin Iordandis:
Yeah. A living definition because it changes depending on what's going on in the world, but also what's going on within the organization and coming back to that idea of experimenting as well, like if you've tried out a new way of working, and that's gotten in the way. But even something that you said there really stood out is, "Okay, it didn't feel good. We might have had too many dependencies." And that brings up the idea of, "Well, how does that flow of value happen?" Oh, that sounds like there's a stifle to the delivery of value. So how do you optimize that flow particularly when there may be multiple people delivering that value?
Rebecca Davis:
Yeah. And I think Scaled Agile gives us some tools for that. So I think one of them is that first session I talked about, value stream and down vacation, so that you can really do a process for talking and discussing with the right blend of people. What is the value and how can we organize around that? I think past that point, there's another tool that I see used far less than I would think it would be, which is value stream mapping. So after we've identified it, now can we actually map what's happening? From concept to cash, which teams are doing pass offs? How long does it take to get an answer on an email? How long is it taking from testing to all the way to release?
Rebecca Davis:
So doing a lot of intentional measurement. Not measurement because we're judging people, but intentional measurement of, we organize this way, this is where all the pieces are connecting, and how long things are taking, as well as how people feel inside of their steps, like does it feel silo? Does it have an outcome? Did we put all of the designers and HR people and engineers on a train, but we made them separate teams, and so it still doesn't feel connected? That's what mapping's for. And those maps and also the program boards that actually visualize like, "Here's the dependencies," versus, "At the end of the PI, this is what those dependencies actually ended up being."
Rebecca Davis:
It's not that dependencies are bad, but they should be adding value, not restricting flow. So I think those connected stories as well as things like employee survey scores and just employee happiness are really good inputs, to, are we delivering flow. And it is a blended view. Some of it's qualitative and some of it's quantitative. But are our own internal things showing us good, bad and different, as well as how are our customers. So do they feel like they're receiving value or that they're receiving bits and pieces and they're unsure about the connected value? I think all of those are indicators.
Jasmin Iordandis:Yeah. And would you say you'd need to have an idea of what those indicators are beforehand, so you can keep an eye on them as the PI progresses? So for example, you've done your value stream mapping, you've built your art. At that point, do you identify what those measurements of flow ought to be and keep an eye on them, or is it more retrospectively where you see these kind of things getting a little bit stuck?
Rebecca Davis:
I think there's both. So definitely those metrics that we indicate inside of the framework are healthy, good for teams and trains and solution trains and portfolio. So I think there is a set of metrics that you should and can utilize. Retrospectives are key, because retrospectives create action. So while we measure, then what's the conversation we have about them? Because what we don't want is vanity metrics. And my personal way of defining vanity metrics is any metric that you do nothing with.
Rebecca Davis:
So I think a key is use them to hold conversations and create outcomes, and create actions and make sure that you're prioritizing those actions. I think there's another piece of just understanding that this is not just about team and train. So teams and trains definitely do need to improve and measure themselves, but so does the portfolio, so does the enterprise, so do the pieces that connect to each other across different trains. So I do think if you over focus on, "Let's just make our teams go faster," you may be missing the whole point of how do we make our organization flow better, which may or may not equate to moving faster right away.
Jasmin Iordandis:
Yeah. Yeah. And team and train don't exist in a vacuuming within that organization like whole bunch of-
Rebecca Davis:
No, [inaudible 00:40:43].
Jasmin Iordandis:
Yeah. Well, I think we've touched on some really, really interesting concepts, and just I can't wait to hit the SAFe Summit, which is a really good segue to the fact that the next time we meet, Rebecca, it will be in person. And you're hosting a workshop at SAFe. Can you give us any sneak peek of what we can expect to be excited about at the summit?
Rebecca Davis:
Yeah. First of all, when we meet each other in person, I'm very short. So I think I'm maybe five foot. So that'll be exciting. So Harry, on the framework team and I, are running a workshop about flow. So we'll be doing a flow workshop. I can't talk about all of it yet, because some of it we're going to announce inside the summit, but I'm really excited. So I think if you do sign up for our workshop, you're going to get active advice, and be able to work also alongside other organizations and other people, really understanding flow, and how to apply improvements to flow and how to identify blockers to flow and what to do about it. So we're really focusing on why do certain things matter and what can you specifically do about it, whether you're at the team level or the train level or solution level or the portfolio level.
Jasmin Iordandis:
Cool. That sounds exciting.
Rebecca Davis:
And we [inaudible 00:42:08] a lot of other workshops, but definitely come to ours.
Jasmin Iordandis:
Well, we've just spoken about the importance of flow, so it makes sense. Right?
Rebecca Davis:
Yeah.
Jasmin Iordandis:
Awesome. Well, I personally am really looking forward to coming to SAFe and coming to Colorado and to get to chat with you a little bit more. But thank you so much for your time and joining us and sharing your expertise and experience on agile transformations, scaling agile and the SAFe framework itself. Thank you so much for your time, Rebecca.
Rebecca Davis:
Yeah, I appreciate it. And I look forward to maybe one day being able to do this in person with you in your own country. So that'll be really awesome.
Jasmin Iordandis:
Yeah. Cool. That would definitely be awesome. Thanks a lot.
Rebecca Davis:
Yeah. Thanks.