The feature provides insightful information on reporting module that demonstrates the results and value of security training related to BullPhish ID. The following article takes you step-by-step in detail.

• Navigate to the left-side menu and select Reporting from the section.
• Click Reporting drop-down that will show you the sub-task of reporting:
  • Export Report
  • Automate Report

Export Report

Reports get generated on the first three days of the following month. Once the report is produced and released, it will be available on the main export report page. You can download early-generated reports anytime through Export Report feature. To access this page, navigate to the left-side menu and select Export Report under the Reporting module.

Note: A Partner Admin/Partner Agent/SMB privileged user can export the report to the local workstation.

To learn more, review the Kaseya Knowledge base article of Export Report.

Automate Report

Reports are now automated, meaning monthly, and quarterly campaign reports will be scheduled and delivered to the specific recipient (s) end-users inboxes via email when a report gets generated - Select Automate Report from the Reporting drop-down section.

Please note that only users who have access to the BullPhish ID portal are allowed to download Monthly/Quarterly reports.

Automate Report has two sub-tabs:

• Schedule
• History

Note: A Partner Admin/Partner Agent/SMB privileged user can set up automated reports. And each user who has a subscription to the Automatic Report page.

Schedule

1. Select an SMB organization from the search bar and create subscriptions for several recipient (s). You can only select one SMB at a time.

2. Select recipient (s): Once the report gets generated, the report will be automatically forwarded to the selected recipient (s)). Provide the email(s) of the recipient (s) in the section where you want to send reports automatically.

3. Provide the Automation Name.

4. Select Report Type.

Here you can automate reports; based on your priority, and you can select either Monthly Business Report, Quarterly Business Report, or both.

5. Click Confirm, which will successfully set up the changes.

History

Click the History tab to view and access your automated report organization's data.

Note: If a user opens the History tab without creating a new automated report, they should choose an SMB organization. But if it's a Privileged User, the SMB organization will be the user's organization. 

You can view and access your automated report organization's data like Automation Name, Report Type, and Actions.

• Q & M represents Quarterly and Monthly.
• Action Buttons:
  • Click Edit, which will take you to the 'Edit Report' form. Here you can make changes to the existing automated reports.
  • Delete will permanently delete the report from the rule.

Report Overview

You can export monthly or Quarterly (Q1, Q2, Q3, and Q4) reports. This article walks you through a sample report as an example.

MONTHLY REPORT

Monthly Reports contain Training and Phishing campaigns of completed/in-progress information of a specific month you wish to download along with the previous month. The report includes a Summary, Phishing Simulation Details, Phished Users, Training & Awareness Details, and Users by Risk Level. Monthly reports display all numbers of actions by status for each campaign. 

QUARTERLY REPORT

Quarterly Reports contain Training and Phishing campaigns of completed/in-progress information. You can export reports in the following order January, February, and March (Q1); April, May, and June (Q2); July, August, and September (Q3); and October, November, and December (Q4). Feature includes similar sections to the monthly report, such as Summary, Phishing Simulation Details, Phished Users, Training & Awareness Details, and Users by Risk Level. Quarterly reports display all numbers of actions by status for each campaign.

Once you open the report, you'll find the following sections. Here is a brief overview of fields/statuses that reports carrying for you.

• Summary
• Phishing Simulation Details
• Phished Users
• Training & Awareness Details
• Users by Risk Level 

Summary: The bar charts contain the Training and Phishing campaigns of completed/in-progress information for a specific month(s). The following table brief you on the monthly and Quarterly summary pages.

• Campaigns: A Training & Awareness campaign will send a prefabricated course, which includes an email template, landing page, and sending profile, to a Group of Targets over a specified date range. Campaigns are created only for the SMB organization.
• Groups: Groups are those who are added to the Phishing and Training campaigns. 
• No Action Taken: Displays the ignored phishing email percentage of targets. The emails are sent to the targets, but the targets ignore the Phishing or Training emails. 
• Open Email: Displays emails that have been opened by the target(s). The target reacted to the email action and opened the email but did not click any link. An Opened Email contains data about all targets who opened emails, related links, or submitted data. 
• Clicked Link: Displays email links clicked by the target(s). Clicked Link contains data about all users who clicked the Link or submitted data. It means the action has been taken, opened the email, and clicked the Link by the target. These links are usually displayed as anchored text or buttons.  
• Submitted Data Displays the information submitted by the target(s). It means the action has been taken, opened the email, clicked the Link, and submitted data by the target. 
• Failed: Displays target information who finished training courses with Failed results. 
• Passed: Displays target information on who finished training courses with Passed results. 
• Incomplete: Displays the users who have taken action about training but incomplete the course in the middle.  

Monthly Report	Quarterly Report

Phishing Simulation Details

The screenshot shows you the Phishing Simulation campaign Details in brief.

Phishing Simulation Campaigns: Phishing Simulation module helps your organization identify and measure the level of vulnerability to phishing attacks present within your organization.

19 Emails Sent/2 Campaigns - It briefs you that the organization conducted 2 Phishing Campaigns, and the Phishing emails were sent to the 19 targeted users successfully. Which indicates a 100% sent.

84%/No Action Taken - The phishing emails were sent to 19 targeted users; out of 19, 16 targeted users ignored the emails. This means that out of 100%, 84% of users ignored the email, and no action was taken against the phishing emails.

16%/Opened Email - The phishing emails were sent to 19 targeted users; out of 19, 3 targeted users opened the emails. Out of 100%,16% opened the Link to check what the email carries.

11%/Clicked Link - The phishing emails were sent to 19 targeted users; out of 19, 3 targeted users opened the emails, and, out of 3, 2 clicked the Link. Out of 100%, 11% of users clicked the Link. These links are usually displayed as anchored text or buttons.

5%/Submitted Data - The phishing emails were sent to 19 targeted users; out of 19, 3 targeted users opened the emails, and out of 3, 2 clicked the Link, and out of 2, 1 submitted data. Out of 100%, only 5% of users clicked the Link.

Summary

• • In Percentage: 84% No action Taken + 16% Opened Email (6% Clicked link + 5% Opened Email + 5% Submitted Data) + 11% Clicked link + 5% Submitted Data) + 5% Submitted Data = 100% Phishing email campaigns sent to targeted users.
  • In Number: 16 No Action Taken + 3 Opened Email (1 Clicked Link + 1 Opened email + 1 Submitted Data) + 2 Clicked Link (1 Clicked Link + 1 Submitted Data) + 1 Submitted Data = 19 Phishing email campaigns sent to targeted users.

Note: Phished Users section displays the list of users who have reacted to the Phishing emails.

The following report section shows you the Phished Users' information, such as the user who has reacted to the email campaign.

Training & Awareness Details

The screenshot shows you the Phishing Simulation Details in brief.

Training & Awareness Campaigns: BullPhish ID's Training & Awareness Module helps organizations with continuous security training improve the security posture of their employees by reducing the risk associated with employee behavior. 

19 Emails Sent/2 Campaigns - It briefs you that the organization conducts 2 Training Campaigns, and the emails were sent to 19 targeted users successfully. Which indicates a 100% sent.

95%/No Action Taken - The Training campaign emails were sent to 19 targeted users; out of 19, 18 targeted users ignored the training emails. This means that out of 100%, 95 % of users ignored the email, and no action was taken against the training.

5%/1 Incomplete - The Training campaign emails were sent to 19 targeted users; out of 19, 1 targeted user opened the training email but was kept incomplete. This means, out of 100%,5% opened the Link to check what does email carries but didn't finish/complete the course.

0%/0 Failed - The Training campaign emails were sent to 19 targeted users; out of 19, 1 targeted user opened the training email but was kept incomplete, and the result failed. This means, out of 100%, 0% of the targeted users failed. Displays target information on who finished courses with Failed results.

0%/0 Passed - The Training campaign emails were sent to 19 targeted users; out of 19, 1 targeted user opened the training email but was kept incomplete, and the result failed. This means, out of 100%, 0% of the targeted users were failed. Displays target information on who finished courses with Failed results.

• Summary
  • In Percentage: 95% No action Taken + 5% Incomplete + 0% Failed + 0% Passed = 100% Training course email campaigns sent to targeted users.
  • In Number: 18 No Action Taken + 1 Incomplete + 0 Failed + 0 Passed = 19 Training email campaigns sent to targeted users.

Note: Users by Risk level section displays the list of users who have reacted to the Training Campaign emails.

DarkWeb ID generated Training and Awareness report 

The Training and Awareness Rating and the Exposure Training values found in the Training and Awareness report generated in DarkWeb ID are described below.

Training and Awareness Rating 

The Training and Awareness Rating is calculated based on campaigns whose status is Running or Completed.

This number is calculated using the following formula:

x = Number of targets that started the training  
y = Number of targets that completed the training  
z = Total number of targets to which the training campaign emails were sent

Formula: (x+y /z*100) 

Exposure Training section

In the Exposure Training section, the organization’s Training and Awareness Rating is compared to other organizations using various criteria.

The criteria are described below using this example.

The value in the first column for each criteria (i.e., Your Industry Size) indicates the number of points that your organization’s score has changed since the last reporting period.

The value in the last column for each criteria indicates the average training score for the current reporting period.

• Your Organization: Your organization’s training scores.
  • First column: In the example, the organization did not have a score in the previous period and therefore, the score is the same as the current reporting period (187).
  • Last column: 187.
     
• Your Industry Size: Compares your organization to all organizations of the same size in the same industry.
  • First column: In the example, the organization’s score fell 9 points since the last reporting period.
  • Last column: The average training score for the current reporting period in the example is 76.
     
• Your Size: Compares your organization to all organizations of the same size.
  • First column: In the example, the organization’s score fell 2 points since the last reporting period.
  • Last column: The average training score for the current reporting period in the example is 43. 
    
    
• Your Industry: Compares your organization to all organizations in the same industry.
  • First column: In the example, the organization’s score fell 4 points since the last reporting period.
  • Last column: In the example, the average training score for organizations in your industry for the current reporting period is 48.