Error: ['Invalid field name: _allow_permissions'] while syncing SharePoint Server Content about enterprise-search-sharepoint-server-connector HOT 10 CLOSED

@rajaseg It looks like the configurations you've used to run your connector has enable_document_permission field set to Yes, but the enterprise search instance does not have a License that allows document level permissions.

Can you confirm from your end if that's the case and try running the connector by making enable_document_permission to No. Let us know if it works by doing so.

from enterprise-search-sharepoint-server-connector.

@rajaseg It looks like the configurations you've used to run your connector has enable_document_permission field set to Yes, but the enterprise search instance does not have a License that allows document level permissions.

Can you confirm from your end if that's the case and try running the connector by making enable_document_permission to No. Let us know if it works by doing so.

@praveen-elastic Thanks for the reply. I confirm that we disabled the 'enable_document_permission' option in the connector configuration while syncing the content

from enterprise-search-sharepoint-server-connector.

Do you mind sharing your configuration file after removing the credentials ? We'll try to replicate this issue.

from enterprise-search-sharepoint-server-connector.

Do you mind sharing your configuration file after removing the credentials ? We'll try to replicate this issue.

@praveen-elastic Please find the config below.

#Configurations for the SharePoint 2016 Connector

#SharePoint 2016 configuration settings
#The domain name of the sharepoint server for NTLM authenticaion
sharepoint.domain: "example.com"
#The username used to login to Sharepoint server
sharepoint.username: "FarmAdmin"
#The password used to login to Sharepoint server
sharepoint.password: "removed"
#The address of the sharepoint farm. Example: http://sharepoint-host:14293/
sharepoint.host_url: "https://sharepoint.example.com/""
#Specifies the site collections whose contents the user wants to fetch and index.
sharepoint.site_collections:
    - marketing
#Workplace Search configuration settings
#Api key for Workplace search authentication
workplace_search.api_key: "jmtgvadouf527obnqjoxrb1a"
#Source identifier for the custom source created on the workplace search server
workplace_search.source_id: "628545984586a6e50e36d0e4"
#Workplace search server address Example: http://es-host:3002/
enterprise_search.host_url: "http://ip:3002/"
#Connector specific configuration settings
#Denotes whether document permission will be enabled or not
#enable_document_permission: Yes
#Specifies the objects to be fetched and indexed in the WorkPlace search along with fields that needs to be included/excluded. The list of the objects supported are collection, site, list, and listItem. By default all the objects are fetched
objects:
    sites:
        include_fields:
        exclude_fields:
    lists:
        include_fields:
        exclude_fields:
    list_items:
        include_fields:
        exclude_fields:
    drive_items:
        include_fields:
        exclude_fields:
#The time after which all the objects that are modified or created are fetched from Sharepoint. By default, all the objects present in the SharePoint till the end_time are fetched
start_time :
#The timestamp before which all the updated objects need to be fetched i.e. the connector won’t fetch any object updated/created after the end_time. By default, all the objects updated/added till the current time are fetched
end_time :
#The level of the logs the user wants to use in the log files. The possible values include: DEBUG, INFO, WARN, ERROR. By default, the level is info
log_level: INFO
#The number of retries to perform in case of server error. The connector will use exponential backoff for retry mechanism
retry_count: 3
#Number of threads to be used in multithreading for the sharepoint sync.
sharepoint_sync_thread_count: 5
#Number of threads to be used in multithreading for the enterprise search sync.
enterprise_search_sync_thread_count: 5
#the path of csv file containing mapping of sharepoint user ID to Workplace user ID
#sharepoint_workplace_user_mapping: "/home/user/users.csv"

from enterprise-search-sharepoint-server-connector.

Hey, @rajaseg, Following is one issue in the config you've shared above:
Since the line enable_document_permission: Yes has been commented out, the connector will take default value (True) for this field from schema.py file.
Hence the connector will try to add permissions in the Enterprise Search instance but since your enterprise search is having basic license which is why you are getting this error: ['Invalid field name: _allow_permissions']

Please try to run your connector will following changes: uncomment the field enable_document_permission and set it to No
Attaching the config with the said changes:

#Configurations for the SharePoint 2016 Connector

#SharePoint 2016 configuration settings
#The domain name of the sharepoint server for NTLM authenticaion
sharepoint.domain: "example.com"
#The username used to login to Sharepoint server
sharepoint.username: "FarmAdmin"
#The password used to login to Sharepoint server
sharepoint.password: "removed"
#The address of the sharepoint farm. Example: http://sharepoint-host:14293/
sharepoint.host_url: "https://sharepoint.example.com/"
#Specifies the site collections whose contents the user wants to fetch and index.
sharepoint.site_collections:
    - marketing
#Workplace Search configuration settings
#Api key for Workplace search authentication
workplace_search.api_key: "jmtgvadouf282obnqjoxrb1a"
#Source identifier for the custom source created on the workplace search server
workplace_search.source_id: "628545276786a6e50e36d0e4"
#Workplace search server address Example: http://es-host:3002/
enterprise_search.host_url: "http://ip:3002/"
#Connector specific configuration settings
#Denotes whether document permission will be enabled or not
enable_document_permission: No
#Specifies the objects to be fetched and indexed in the WorkPlace search along with fields that needs to be included/excluded. The list of the objects supported are collection, site, list, and listItem. By default all the objects are fetched
objects:
    sites:
        include_fields:
        exclude_fields:
    lists:
        include_fields:
        exclude_fields:
    list_items:
        include_fields:
        exclude_fields:
    drive_items:
        include_fields:
        exclude_fields:
#The time after which all the objects that are modified or created are fetched from Sharepoint. By default, all the objects present in the SharePoint till the end_time are fetched
start_time :
#The timestamp before which all the updated objects need to be fetched i.e. the connector won’t fetch any object updated/created after the end_time. By default, all the objects updated/added till the current time are fetched
end_time :
#The level of the logs the user wants to use in the log files. The possible values include: DEBUG, INFO, WARN, ERROR. By default, the level is info
log_level: INFO
#The number of retries to perform in case of server error. The connector will use exponential backoff for retry mechanism
retry_count: 3
#Number of threads to be used in multithreading for the sharepoint sync.
sharepoint_sync_thread_count: 5
#Number of threads to be used in multithreading for the enterprise search sync.
enterprise_search_sync_thread_count: 5
#the path of csv file containing mapping of sharepoint user ID to Workplace user ID
#sharepoint_workplace_user_mapping: "/home/user/users.csv"

from enterprise-search-sharepoint-server-connector.

Hey, @rajaseg, Following is one issue in the config you've shared above: Since the line enable_document_permission: Yes has been commented out, the connector will take default value (True) for this field from schema.py file. Hence the connector will try to add permissions in the Enterprise Search instance but since your enterprise search is having basic license which is why you are getting this error: ['Invalid field name: _allow_permissions']

Please try to run your connector will following changes: uncomment the field enable_document_permission and set it to No Attaching the config with the said changes:

#Configurations for the SharePoint 2016 Connector

#SharePoint 2016 configuration settings
#The domain name of the sharepoint server for NTLM authenticaion
sharepoint.domain: "example.com"
#The username used to login to Sharepoint server
sharepoint.username: "FarmAdmin"
#The password used to login to Sharepoint server
sharepoint.password: "removed"
#The address of the sharepoint farm. Example: http://sharepoint-host:14293/
sharepoint.host_url: "https://sharepoint.example.com/"
#Specifies the site collections whose contents the user wants to fetch and index.
sharepoint.site_collections:
    - marketing
#Workplace Search configuration settings
#Api key for Workplace search authentication
workplace_search.api_key: "jmtgvadouf282obnqjoxrb1a"
#Source identifier for the custom source created on the workplace search server
workplace_search.source_id: "628545276786a6e50e36d0e4"
#Workplace search server address Example: http://es-host:3002/
enterprise_search.host_url: "http://ip:3002/"
#Connector specific configuration settings
#Denotes whether document permission will be enabled or not
enable_document_permission: No
#Specifies the objects to be fetched and indexed in the WorkPlace search along with fields that needs to be included/excluded. The list of the objects supported are collection, site, list, and listItem. By default all the objects are fetched
objects:
    sites:
        include_fields:
        exclude_fields:
    lists:
        include_fields:
        exclude_fields:
    list_items:
        include_fields:
        exclude_fields:
    drive_items:
        include_fields:
        exclude_fields:
#The time after which all the objects that are modified or created are fetched from Sharepoint. By default, all the objects present in the SharePoint till the end_time are fetched
start_time :
#The timestamp before which all the updated objects need to be fetched i.e. the connector won’t fetch any object updated/created after the end_time. By default, all the objects updated/added till the current time are fetched
end_time :
#The level of the logs the user wants to use in the log files. The possible values include: DEBUG, INFO, WARN, ERROR. By default, the level is info
log_level: INFO
#The number of retries to perform in case of server error. The connector will use exponential backoff for retry mechanism
retry_count: 3
#Number of threads to be used in multithreading for the sharepoint sync.
sharepoint_sync_thread_count: 5
#Number of threads to be used in multithreading for the enterprise search sync.
enterprise_search_sync_thread_count: 5
#the path of csv file containing mapping of sharepoint user ID to Workplace user ID
#sharepoint_workplace_user_mapping: "/home/user/users.csv"

@praveen-elastic Thanks for the input. I will try that option and update the outcome.

from enterprise-search-sharepoint-server-connector.

@praveen-elastic I was able to sync the content from the SharePoint server to Workplace search. But the metadata is missing and the link is not enabled.

from enterprise-search-sharepoint-server-connector.

Hey @rajaseg, can you please provide more input regarding the metadata which is missing ? Probably a screenshot of the same would be helpful.

from enterprise-search-sharepoint-server-connector.

Hey @rajaseg, can you please provide more input regarding the metadata which is missing ? Probably a screenshot of the same would be helpful.

Hey, @praveen-elastic Please find the screenshot below. Link not clickable and missing metadata of the file

It should show metadata like the below image. The link is clickable here.

from enterprise-search-sharepoint-server-connector.

Hey, @rajaseg, I've created separate issue for this. You can track that here #55

from enterprise-search-sharepoint-server-connector.