This setup requires access to some credentials:

Adobe Magento Marketplace and Access Keys
This project requires the Magento extension mageplaza/module-customer-approval which is only available at the Magento Marketplace. Therefore, a Magento Marketplace account is required and the extension needs to be added to your account. The extension is completely free of charge and no payment information needs to be provided for this step.
The access keys of your account need to be copied into a new file called auth.json within the /magento folder. A template for this file is available at magento/auth.template.json.

Mail Account Information
The Magento web shop sends multiple mails to customers and administrators, e.g., when a new customer registers or to confirm a mail address. Therefore, this project requires at least four different mail accounts: three mail accounts for customers and one administrator mail account. All e-mails will be sent via the administrator mail account.

Important: For a full running demo, the mail adresses within the file legacy-system/db/docker-entrypoint-initdb.d/01-testdata.sql need to be replaced by two of your own mail adresses.

For the sake of simplicity, this project uses the mail server of Gmail. In order to configure Magento accordingly, the mail address and password of a Gmail account needs to be known. The security preferences of the Gmail account must allow connections from Magento.

• Docker and docker-compose

• the setup was tested on Ubuntu (20.04.3)

• the setup needs to be started using a stable internet connection to download all docker images and dependencies

• the ports listed in the section "Service Access" need to be available

1) Start all components using the setup script. Beforehand, make sure that the script is executable.

Remark: The containers will expose multiple ports. To ensure that the applications are available from your host, make sure that the ports documented in the section "Service Access" are available.

2) Wait until all components are in a healthy state. This can be checked using:

3) Execute the steps explained in "Installation of Extensions".

4) Navigate to http://localhost/admin and log in as admin user (username: user, password: bitnami1).

5) In Magento, navigate to System > Integrations. Add a new integration with the name "kafka" and make sure to select "All" as resource access property. Activate it and copy the API Access Token.
Replace the variable BEARER_TOKEN with the token within the following files:

• connect/distributed/config/connector-http-source-magento.json

• connect/distributed/config/connector-http-sink-magento-post.json

• connect/distributed/config/connector-http-sink-magento-put.json

6) Configure the SMTP extension like described in "SMTP Configuration".

7) In Magento, navigate to Stores > Configuration > Customers > Customer Configuration > Create New Account Options. Scroll down and set "Require Emails Confirmation" to "Yes". Save the configuration.

8) In Magento, navigate to Stores > Configuration > General > Store Email Addresses. Change all service mail addresses to the email address of this project. Save the configuration.

9) Deploy the Kafka topics, Kafka Connect and the connectors:

10) Deploy all KSQL statements:

If all statements were deployed successfully, it should take a few minutes until the ERP-customers are visible in Magento at: Customers > All Customers.

To register a new customer, navigate to http://localhost:80. The new customer can be approved via the Magento admin panel. If the mail address of the new customer is confirmed, it will be transferred to the ERP and CRM databases.

To stop all components:

To remove all volumes for complete cleanup:

To only cleanup the Kafka and Confluent components:

The bitnami Docker image does not include a mail server. Therefore, it is not possible to send service mails by default. To enable this, the SMTP extension magepal/magento2-gmailsmtpapp needs to be installed.

Additionally, the usage scenario on which this work is based requires that new accounts are activated by an administrator before they can be used. For this reason, the mageplaza/module-customer-approval extension must also be installed.
The scenario also requires that new customers provide their personal address at registration. For this requirement, the faonni/module-customer-create-address is used.

Some steps for the installation are already prepared via the Dockerfile. For the final installation, the following steps need to be taken:

Important: Afterwards, the container needs to be stopped, removed and re-started. There currently is no other possibility to enforce a database scheme update.

Warning: Do not use "module:enable --all". This will activate all modules, including Two-Factor-Authentication for the administrator. Then, it will not be possible to log in - even using the admin account.

Navigate to Stores > Configuration > Advanced > System > SMTP Configuration and Settings.
Select "Yes" for "Enable" and set the following settings:

• Local client name (domain or IP): localhost

• Authentication method: LOGIN

• SSL type: TLS

• SMTP Host: smtp.gmail.com (depending on your mail account!)

• Port: 587

• Username: <thesis-mail-account>

• Password: <thesis-mail-account-password>

Make sure that the configuration is saved.

curl -X GET 'localhost:80/rest/V1/customers/1' --header 'Authorization: Bearer <your-bearer-token>' -H "Content-Type: application/json"

curl -X GET 'localhost:80/rest/V1/customers/search?searchCriteria[sortOrders][0][field]=email&searchCriteria[sortOrders][0][direction]=asc' --header 'Authorization: Bearer <your-bearer-token>' -H "Content-Type: application/json"

curl -X POST http://localhost:80/rest/V1/customers --header 'Authorization: Bearer <your-bearer-token>' -H "Content-Type: application/json" --data-raw '{
   "customer" : {
      "lastname" : "Doe",
      "firstname" : "Jane",
      "email" : "[email protected]",
      "taxvat": "345234/532453523",
      "store_id": 1,
      "group_id": 1,
      "website_id": 1,
      "addresses" : [
         {
            "firstname" : "Jane",
            "lastname" : "Doe",
            "countryId" : "US",
            "postcode" : "10755",
            "city" : "Purchase",
            "street" : [
               "123 Oak Ave"
            ],
            "telephone" : "512-555-1111"
         }
      ],
     "custom_attributes": [
        {
        "attribute_code": "is_approved",
        "value": "approved"
        }
     ]
   }
}'

docker exec -it erp-db bash
mariadb -h localhost -P 3307 -u root -p erpSys

UPDATE customer
SET Taxvat = "1122334455"
WHERE Email = "[email protected]";

docker exec -it kafka bash

kafka-topics --bootstrap-server localhost:9092 --list
kafka-console-consumer --bootstrap-server localhost:9092 --from-beginning --property print.key=true --topic <topic-name>